-- Logs begin at Fri 2022-06-24 14:18:10 UTC, end at Fri 2022-06-24 15:41:58 UTC. -- Jun 24 14:58:13.639534 dv-cinder-835384-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 24 14:58:13.648430 dv-cinder-835384-11-smb devstack@keystone.service[80499]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 14:58:13 2022] *** Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: nodename: dv-cinder-835384-11-smb Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: machine: x86_64 Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: clock source: unix Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: pcre jit disabled Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: detected number of CPU cores: 4 Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: current working directory: / Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: detected binary path: /usr/bin/uwsgi-core Jun 24 14:58:13.650373 dv-cinder-835384-11-smb devstack@keystone.service[80499]: your processes number limit is 47680 Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: your memory page size is 4096 bytes Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: detected max file descriptor number: 2048 Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: lock engine: pthread robust mutexes Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: thunder lock: enabled Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 24 14:58:13.650984 dv-cinder-835384-11-smb devstack@keystone.service[80499]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 14:58:13.694928 dv-cinder-835384-11-smb devstack@keystone.service[80499]: Python main interpreter initialized at 0x562bda3839c0 Jun 24 14:58:13.694928 dv-cinder-835384-11-smb devstack@keystone.service[80499]: python threads support enabled Jun 24 14:58:13.694928 dv-cinder-835384-11-smb devstack@keystone.service[80499]: your server socket listen backlog is limited to 100 connections Jun 24 14:58:13.694928 dv-cinder-835384-11-smb devstack@keystone.service[80499]: your mercy for graceful operations on workers is 90 seconds Jun 24 14:58:13.695306 dv-cinder-835384-11-smb devstack@keystone.service[80499]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 14:58:13.695381 dv-cinder-835384-11-smb devstack@keystone.service[80499]: *** Operational MODE: preforking *** Jun 24 14:58:13.695672 dv-cinder-835384-11-smb devstack@keystone.service[80499]: *** uWSGI is running in multiple interpreter mode *** Jun 24 14:58:13.695672 dv-cinder-835384-11-smb devstack@keystone.service[80499]: spawned uWSGI master process (pid: 80499) Jun 24 14:58:13.695888 dv-cinder-835384-11-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 24 14:58:13.697880 dv-cinder-835384-11-smb devstack@keystone.service[80499]: spawned uWSGI worker 1 (pid: 80512, cores: 1) Jun 24 14:58:13.697880 dv-cinder-835384-11-smb devstack@keystone.service[80499]: spawned uWSGI worker 2 (pid: 80513, cores: 1) Jun 24 14:58:13.697880 dv-cinder-835384-11-smb devstack@keystone.service[80499]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 14:58:19.187779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:58:19.187779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: from cryptography.utils import int_from_bytes Jun 24 14:58:19.188569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:58:19.188569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: from cryptography.utils import int_from_bytes Jun 24 14:58:19.188682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:58:19.188682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: from cryptography.utils import int_from_bytes Jun 24 14:58:19.189095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 14:58:19.189095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: from cryptography.utils import int_from_bytes Jun 24 14:58:19.237494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 14:58:19.237688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 14:58:19.237918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] command line args: [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 14:58:19.238021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 14:58:19.238133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 14:58:19.238221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 14:58:19.238332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] command line args: [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 14:58:19.238418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ================================================================================ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 14:58:19.238598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] admin_token = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.238684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 14:58:19.238763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ================================================================================ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 14:58:19.238834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_dir = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] admin_token = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] config_source = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_dir = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] debug = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] config_source = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.239944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] debug = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.240421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_config_append = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_config_append = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_dir = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.241968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_dir = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.242978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.243915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.244970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] publish_errors = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.245919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] publish_errors = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.246936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] standard_threads = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] standard_threads = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_journal = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.247952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_json = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_journal = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_stderr = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_json = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] use_syslog = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_stderr = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] use_syslog = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 14:58:19.248776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.248926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.249928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250485 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.250965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.251945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.252912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.253994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.254913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.255839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.256937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.257951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.258973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.259975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.260980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.261947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.262882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.263974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.264999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.265926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.266963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.267915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.268856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.269994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.270928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.271935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.272633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.273925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.external = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.external = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.274857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.password = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] auth.token = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.password = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] auth.token = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.275975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.276937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.277992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.278946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.279907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.280938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.281934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.282886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.283841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.284979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.285977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.286936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.287884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.288055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.288135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.288316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.288426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.289969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.290856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.291974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.292999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.293977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.294914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.295859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.296978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.297961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.298916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.299920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.300897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.301957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.302860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.303994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.304940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.305986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.306962 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.307927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.308866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.309867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.310999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.311972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.312944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.313951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.314923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.315864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.316972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.317970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.318937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.319951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.320942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321652 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.321928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.322946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.323880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.324989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.325912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80513) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 14:58:19.325999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 14:58:19.326149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 14:58:19.357412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.357620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.357865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.358059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.358294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.358522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.366538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.367204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.394562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.395075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.395251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.395484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.537208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.538077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.587201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.587435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.587970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.588206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.652985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.653086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.653200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.653285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.653416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.653634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.677920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.678991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.679100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.679180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.679255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.679383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.690243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.690576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.703388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.703620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.703830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.703915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80513) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.704911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.705127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80512) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 24 14:58:19.723341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.723548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:58:19.723706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.723886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.723971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:58:19.724090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:58:19.724235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.724362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.724448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 24 14:58:19.724626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.724708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.724884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.724966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.725140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.725223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.725414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.736910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.737108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.737192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.745443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.745539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.748772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.748859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.749050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.749921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.750992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.751123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.751255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.751654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.751785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.751915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.779637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.779864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.781285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.781418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.781548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.781674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.786875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.787028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.787346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.787487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.787621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.787755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.795035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.795205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.795330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.795480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.799859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.800005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.800175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.800287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.800458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.800565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.800740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.800832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.801949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.821100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.821378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.821553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.821676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.826036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.826362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.829674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.830076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.830171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.830489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.835212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.836193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.839360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.839881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.843070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.843367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.843590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.843683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.843888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.843983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.844172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.844276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.844449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.844542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.844747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.845039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.863788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.864073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.864340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.864436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.864611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.864705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.864917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.865193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.872643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.873322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.874371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.874644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.875097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.875373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.878244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.878543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.878842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.878997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.879144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.879277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.879454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.879552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.879833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.880110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.893365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.893635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.893948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.894136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.894284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.894421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.894698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.894976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.895926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.896221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.896517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.896726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.897023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.897321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.915178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.916133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.918525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.919509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.922860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.923616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.924585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.925258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.925534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.925839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.926352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.926621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.926906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.933269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.934428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.934900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.936040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.938166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.938465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.938856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.939134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.939322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.939629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.940023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.940306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.948845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.949126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.949412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.950110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.950396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.950679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.957336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80513) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.957609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.957978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.958255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.958525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.958654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80512) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 24 14:58:19.958889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.959878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.960010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.960174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.960789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.960929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80513) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.961924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.962055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.962262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.962508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.962779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80512) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 24 14:58:19.999990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bda3839c0 pid: 80513 (default app) Jun 24 14:58:20.003696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562bda3839c0 pid: 80512 (default app) Jun 24 14:58:20.003803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6145-d46d-44c9-ada1-024b501fb99a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:20.003993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6145-d46d-44c9-ada1-024b501fb99a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:20.004269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e6145-d46d-44c9-ada1-024b501fb99a None None] PATH_INFO: `/v3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:20.009417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Fri Jun 24 14:58:20 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:28.778882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:28.779405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:28.779405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:28.783684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:28.790326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:28.790762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:28.790877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:28.859852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: INFO dbcounter [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] Registered counter for database keystone Jun 24 14:58:28.881623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG oslo_db.sqlalchemy.engines [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80513) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 14:58:28.887982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writer thread running {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 14:58:29.068221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG passlib.handlers.bcrypt [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80513) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 14:58:29.068549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG passlib.handlers.bcrypt [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80513) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 14:58:29.122907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:29.124525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:29.246509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 24 14:58:29.392325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:29.463723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: INFO dbcounter [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] Registered counter for database keystone Jun 24 14:58:29.482694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG oslo_db.sqlalchemy.engines [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 14:58:29.489135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writer thread running {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 14:58:29.612843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e0b79-49ef-4b8c-bab8-ab3d59390418 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:29.617214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:29.617909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:29.618194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:29.618474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:29.627124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:29.680130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 14:58:29.680409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8cba42-b97c-4cbd-85d2-8435ef04997c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:29.690616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Fri Jun 24 14:58:29 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 14:58:29.697099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:29.712005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57326bbe-e917-4c9d-9330-b23c117871d1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:29.716409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:29.717544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:29.717862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:29.718136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] PATH_INFO: `/v3/projects/7700ba2abc17485289dad312ea30cdcc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:29.722182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] RBAC: Authorizing `identity:get_project(project_id=7700ba2abc17485289dad312ea30cdcc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:29.773416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 24 14:58:29.773770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057ed3-a747-40b1-861f-d056ff058bac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:29.778326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Fri Jun 24 14:58:29 2022] GET /identity/v3/projects/7700ba2abc17485289dad312ea30cdcc => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:31.788493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ac-20bf-4124-aab3-731be55c4730 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:31.789066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ac-20bf-4124-aab3-731be55c4730 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:31.789066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d86ac-20bf-4124-aab3-731be55c4730 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:31.793194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:58:31.798475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:31.798869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:31.799038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:31.819066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:31.820612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:31.828541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 24 14:58:31.851563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d86ac-20bf-4124-aab3-731be55c4730 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:31.863509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d86ac-20bf-4124-aab3-731be55c4730 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:31.868310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:31.868926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:31.869208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:31.869481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:31.877413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:31.879213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b8ce8-6e7d-4303-af53-36eb70237817 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:31.887839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Fri Jun 24 14:58:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 14:58:31.893850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:31.903006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d21316-5912-4f90-93d6-5f65504e0abe None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:31.907443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:31.908307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:31.908587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:31.908866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:31.910549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:31.912374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add350e-0004-4ea3-a7e7-9cc072660f12 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:31.914489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Fri Jun 24 14:58:31 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:33.999432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ef09-b7fd-4d64-b6ef-453e66c7e4b7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:33.999988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ef09-b7fd-4d64-b6ef-453e66c7e4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:33.999988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1104ef09-b7fd-4d64-b6ef-453e66c7e4b7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.001592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:34.007601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.008023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.008160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.025469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:34.026683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:34.034777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eeec-70f9-4e7c-a3be-68e796206b29 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.035069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eeec-70f9-4e7c-a3be-68e796206b29 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.035347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad74eeec-70f9-4e7c-a3be-68e796206b29 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.036696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:58:34.041861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.042148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.042420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.081971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG passlib.handlers.bcrypt [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80512) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 24 14:58:34.082395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG passlib.handlers.bcrypt [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80512) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 24 14:58:34.108848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:34.128072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:34.129661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:34.132488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.156114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.242087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:34.243202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae14162a-a785-4da0-a112-746fb5d18d25 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.265164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.281519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.282368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.282656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.282938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.294481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:34.306354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:34.307337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:34.308178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:58:34.313415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.366559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3e3ab-a6fd-428d-b79c-284a3ddc4403 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.368858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.398372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.405138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.406075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.406361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.406638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.417173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334e901-b92e-4f75-8fbc-13cc35524286 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.453778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.454446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.454726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.455001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.455747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:34.456052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.457446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.468994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:34.474648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.475511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.477040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.573968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9fc132-bd68-4182-a236-30a59d1e10f2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.575301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:58:34.581055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.583793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.611665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.612543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.612826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.613102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.614418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.616461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.618152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:34.623600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.637904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.684720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d35b16-bbd9-47e6-9dbd-4af2b2db9092 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.717417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440902c-862f-4243-b287-26aba1382968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.718237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440902c-862f-4243-b287-26aba1382968 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.718518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440902c-862f-4243-b287-26aba1382968 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.718792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440902c-862f-4243-b287-26aba1382968 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.722832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb85cbe6-c8d5-48ee-8af9-df92d1718590 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.738831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440902c-862f-4243-b287-26aba1382968 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.740296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440902c-862f-4243-b287-26aba1382968 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.758704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.759500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.759784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.760062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.761248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2440902c-862f-4243-b287-26aba1382968 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:58:34.761517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:34.762435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:34.763521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:58:34.763521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:58:34.763521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:58:34.763521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:34.763521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 9/18] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:58:34.763936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.764635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 10/19] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:34.770202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.770321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440902c-862f-4243-b287-26aba1382968 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:34.826863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.850382 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:34.869894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d9bf7-3908-4b76-aa19-b0f4fb0fe01f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.871020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440902c-862f-4243-b287-26aba1382968 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:34.903740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.904229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:34.904407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.904690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.904881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:34.904967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.905166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:34.905444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:34.905672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:34.906005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.906335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.domain.id=default, user.id=f6d21cfc252e4afe8cc1bf635f18f2d8) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:34.906648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:34.907369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56d65a-165f-41ff-b9e3-6d5987cbb1c4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.908101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb80ae-4408-49ed-9da0-04b4d0a5a49d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:34.916892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 10/20] 10.222.0.65 () {56 vars in 1322 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/role_assignments?user.id=f6d21cfc252e4afe8cc1bf635f18f2d8&scope.domain.id=default&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:34.925676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 11/21] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:37.094428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37c44-3783-4539-a97a-80d6b0599972 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.095442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37c44-3783-4539-a97a-80d6b0599972 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.095921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f37c44-3783-4539-a97a-80d6b0599972 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.097496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 11/22] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:37.102891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.103711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.104197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.126780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:37.128316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:37.218842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 12/23] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:37.248168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f37c44-3783-4539-a97a-80d6b0599972 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:37.375871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f37c44-3783-4539-a97a-80d6b0599972 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:37.404715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:37.422350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:37.423188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.423470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.423741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.446615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-75825ae6-88f4-41f6-83f2-8af04f13b6fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:37.455465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:37.456396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:37.457582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 12/24] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:58:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:37.462804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:37.541139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:37.574269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140215-67ee-487e-bce1-0fc32e479393 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.574573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140215-67ee-487e-bce1-0fc32e479393 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.574816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140215-67ee-487e-bce1-0fc32e479393 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.576357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 13/25] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:58:37.581254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.581536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.581839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.603843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953eb1d-2281-49eb-92cc-f4ce08dcb0ec None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:37.618034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:37.619249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:37.678713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:37.679743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:37.680396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:37.680875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:37.681912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:37.682442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:37.684108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:37.707995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 13/26] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:37.714121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:37.777917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 14/27] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:37.814285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:37.914314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7f837d-9a9d-43ee-b4a0-a6b692c780eb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.011236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:38.014396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88095be-86a2-4aa3-82dd-445946c72092 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.026398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.027278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.027556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.028100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.028787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:38.029065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.030556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3aa51-1b44-4c8a-8a99-94abaec11de5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.032576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 14/28] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:37 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:38.033902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b737f-8e79-4af5-b98f-84c162ea430f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.034191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b737f-8e79-4af5-b98f-84c162ea430f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.034465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b737f-8e79-4af5-b98f-84c162ea430f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.035981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 15/29] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:38.038314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b737f-8e79-4af5-b98f-84c162ea430f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:38.074414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.075216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.075492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.075765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.092230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.093745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a083f66d-323e-4946-93b4-dc224ac30d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:58:38.124636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:38.126210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:38.127002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:58:38.127002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:58:38.127002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:58:38.127002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:38.128772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 15/30] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:58:38.139681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.139963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.140241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.164847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:38.166211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:38.212971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b737f-8e79-4af5-b98f-84c162ea430f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.258481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.259280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.259558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.259831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.261005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.262654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.264535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 16/31] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:38.265336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:38.315040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 16/32] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:38.316015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:38.354683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:38.391208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f558e6-dd01-4510-9b32-24047c78fb15 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.428458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.429128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.429411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.429689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.430544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:38.430854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.432355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb7f8c-d4e6-4a40-8aaa-4d5bb854aab4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.443083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:38.447623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 17/33] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:38.453434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908697e-7ff8-4080-8c2a-65351037aed8 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.453740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908697e-7ff8-4080-8c2a-65351037aed8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.453874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fe7ed-a079-4e7f-8342-764295472593 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.454045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908697e-7ff8-4080-8c2a-65351037aed8 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.459899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 18/34] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:38.459899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908697e-7ff8-4080-8c2a-65351037aed8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:38.497712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.498901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.500034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.500576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] PATH_INFO: `/v3/domains/default/users/f6d21cfc252e4afe8cc1bf635f18f2d8/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.502982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f6d21cfc252e4afe8cc1bf635f18f2d8, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.504439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.570941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908697e-7ff8-4080-8c2a-65351037aed8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.602236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:38.610945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.611900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.612337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.612770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.613703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.615376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b1e255-64aa-4fde-b229-dbf68a15fc34 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.698328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 17/35] 10.222.0.65 () {58 vars in 1361 bytes} [Fri Jun 24 14:58:38 2022] PUT /identity/v3/domains/default/users/f6d21cfc252e4afe8cc1bf635f18f2d8/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:58:38.699616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:38.801376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 19/36] 10.222.0.65 () {60 vars in 1131 bytes} [Fri Jun 24 14:58:38 2022] POST /identity/v3/roles => generated 219 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:38.803770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d9ca-9fe4-4786-91b8-0d85110c117b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.804276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d9ca-9fe4-4786-91b8-0d85110c117b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.804730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23d9ca-9fe4-4786-91b8-0d85110c117b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.824778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ff23d9ca-9fe4-4786-91b8-0d85110c117b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:38.826734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ff23d9ca-9fe4-4786-91b8-0d85110c117b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:38.837243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4aa2-2e6b-4ba0-8562-cf0884d018b4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:38.882259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:38.883222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.883663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.884089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.884818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:38.887226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89beed-bfab-4f30-8a2d-ea7c3d30988f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:38.918586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 20/37] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:38.919983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccf9f-ad0d-4383-8365-06717e0d51f0 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.920277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccf9f-ad0d-4383-8365-06717e0d51f0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.920607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccf9f-ad0d-4383-8365-06717e0d51f0 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.924523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 21/38] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:38.924523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287367-3760-40c9-9120-c5a1763d9a80 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.924523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287367-3760-40c9-9120-c5a1763d9a80 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.924523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58287367-3760-40c9-9120-c5a1763d9a80 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.925500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 22/39] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:38.931149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:38.931426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:38.931991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:38.950756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:38.952101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:39.017527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 18/40] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 14:58:38 2022] POST /identity/v3/projects => generated 301 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:39.022037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:39.022333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:39.022623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:39.029943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:39.038556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 23/41] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:39.039874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:39.054662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:39.056341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:39.157874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 19/42] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:39.158857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:39.244411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:39.306145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9acb4-803b-4bf7-b75a-c2fad20bbb63 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:39.313948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91463b49-9a41-4209-a5a0-2c12a596bb5a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:39.345968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:39.346645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:39.346934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:39.347213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:39.347966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:39.349358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:39.351676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:39.353017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:39.354150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:39.354527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:39.354806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:39.355558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:39.357066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:39.452815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 20/43] 10.222.0.65 () {60 vars in 1131 bytes} [Fri Jun 24 14:58:39 2022] POST /identity/v3/roles => generated 223 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:39.453415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:39.465762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 24/44] 10.222.0.65 () {60 vars in 1131 bytes} [Fri Jun 24 14:58:39 2022] POST /identity/v3/roles => generated 225 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:39.585587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d5230-69d6-4815-a6f7-f50a4f7fa7b6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:39.627283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:39.628274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:39.628618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:39.628945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:39.630270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:39.632401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63a2ac-9d7e-48c6-94a0-8bd6ba2a34ee None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:39.634262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 21/45] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:39.643402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:39.761328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f0462-73bd-45d6-bc31-95e307c5735f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:39.770665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:39.794979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:39.795639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:39.795917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:39.796191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:39.796896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:39.798432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ef67a-ec8e-4fc7-9554-b396b03cc9f4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:39.904314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 25/46] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 14:58:39 2022] POST /identity/v3/projects => generated 312 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:40.854252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbfea4-5020-407b-bc9f-a35c0f817501 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:40.854762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbfea4-5020-407b-bc9f-a35c0f817501 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:40.854868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbfea4-5020-407b-bc9f-a35c0f817501 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:40.856323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 22/47] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:40.861327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:40.861760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:40.861943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:40.878851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:40.880045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:40.946469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 26/48] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:40.969935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbfea4-5020-407b-bc9f-a35c0f817501 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:41.034334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:41.074536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbfea4-5020-407b-bc9f-a35c0f817501 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:41.108047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:41.108761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.109047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.109332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.120204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:41.128143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:41.129193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:41.130575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 23/49] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:58:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:41.135838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:41.229840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:41.239515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde235-abfd-4d38-a2cb-70c6b4b97ea4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:41.273828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:41.274682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.275391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.275655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.276425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:41.276738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:41.278180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:41.286311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 27/50] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:41.291934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:41.403750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a7bba-0107-49ab-b5ac-fa262ded7d09 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:41.426697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:41.438509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:41.439397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.440060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.440060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.441151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:41.442660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:41.444296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 24/51] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:41 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:41.450417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:41.553096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd2fe8-d2f1-45a6-9b51-58035a894355 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:41.585668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:41.586487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.586775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.587058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.588238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:41.589692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f74442-ad89-46aa-bc39-338d5dc337c4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:41.591362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 28/52] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:41.597015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:41.707154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587353a5-b8cd-4866-9304-57b34d105116 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:41.741251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:41.741930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.742220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.742504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.743331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.domain.id=default, user.id=f6d21cfc252e4afe8cc1bf635f18f2d8) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:41.743646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:41.745103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546d7f1-f44b-466a-b719-58e547c272e1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:41.751211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 25/53] 10.222.0.65 () {56 vars in 1322 bytes} [Fri Jun 24 14:58:41 2022] GET /identity/v3/role_assignments?user.id=f6d21cfc252e4afe8cc1bf635f18f2d8&scope.domain.id=default&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 530 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:41.954195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14cf19-5ae5-4a5c-96a4-0efa0d0c6468 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.954699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14cf19-5ae5-4a5c-96a4-0efa0d0c6468 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.954789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14cf19-5ae5-4a5c-96a4-0efa0d0c6468 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.956269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 29/54] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:41.961905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:41.962321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:41.962421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:41.979659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:41.980847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:42.028730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:42.045649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 26/55] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:42.069103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14cf19-5ae5-4a5c-96a4-0efa0d0c6468 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:42.091654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:42.169671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14cf19-5ae5-4a5c-96a4-0efa0d0c6468 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:42.202429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:42.203214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:42.203522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:42.203798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:42.204994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:42.206470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1172be63-fcfb-46fe-97bd-1141278e3aa6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:42.208100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 30/56] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:42.214432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:42.317350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd3dd3-b441-4506-a98c-06e3ab8ef467 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:42.454959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:42.455620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:42.455897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:42.456174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:42.456875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:42.458358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431124e-13be-4236-8a49-8b8b802ca69e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:42.548479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 27/57] 10.222.0.65 () {60 vars in 1140 bytes} [Fri Jun 24 14:58:42 2022] POST /identity/v3/projects => generated 298 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:44.578717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ad02-9278-4a0d-872f-3fc9f37df80b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:44.579205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ad02-9278-4a0d-872f-3fc9f37df80b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:44.579205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f2ad02-9278-4a0d-872f-3fc9f37df80b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:44.580570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 31/58] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:44.585583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:44.586021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:44.586170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:44.602933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:44.604111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:44.633067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:44.672202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 28/59] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:44.696455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ad02-9278-4a0d-872f-3fc9f37df80b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:44.784186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:44.796936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f2ad02-9278-4a0d-872f-3fc9f37df80b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:44.829657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:44.830409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:44.830696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:44.830980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:44.832168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:44.833613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cd2a9-fae3-40c5-b742-568f84baea4d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:44.835837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 32/60] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:44.841231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:44.935903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b6100-aa1c-4644-9acc-d6789e4fae4d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:44.968304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:44.968959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:44.969239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:44.969512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:44.970242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:44.971669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3b3f4-9a19-461d-93da-65d0842af567 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:45.073890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 29/61] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:58:44 2022] POST /identity/v3/users => generated 275 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:48.316255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62289ae-8707-4e8c-b5a1-2881292cc56c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.316756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62289ae-8707-4e8c-b5a1-2881292cc56c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.316931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62289ae-8707-4e8c-b5a1-2881292cc56c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.318447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 33/62] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:48.345979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.346483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.346703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.368522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:48.369749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:48.391618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:48.460275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 30/63] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:48.489323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4399-e749-4f4b-ad51-005af1b6f12d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.489933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4399-e749-4f4b-ad51-005af1b6f12d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.490433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9e4399-e749-4f4b-ad51-005af1b6f12d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.492562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 34/64] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:48.497742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:48.505647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000a5a-af2a-4577-b885-0e6be174c089 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.506217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000a5a-af2a-4577-b885-0e6be174c089 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.506741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89000a5a-af2a-4577-b885-0e6be174c089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.526257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-89000a5a-af2a-4577-b885-0e6be174c089 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:48.527814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-89000a5a-af2a-4577-b885-0e6be174c089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:48.612102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 35/65] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:48.614413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73face30-f6c7-4d27-98d3-0fdcc5beb268 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.614932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73face30-f6c7-4d27-98d3-0fdcc5beb268 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.615867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73face30-f6c7-4d27-98d3-0fdcc5beb268 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.618862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 36/66] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:48.626056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.626631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.627398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.645644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555a48a-ec90-44db-8422-efc971a4d477 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:48.650577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:48.651900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:48.687888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:48.689222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.689646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.690244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.704766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:48.714694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:48.715613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:48.716346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:48.718723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 31/67] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:48.720141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:48.740030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:48.746896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 37/68] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:48.747880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:48.768381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:48.837988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c31cea-5032-4cae-8b7e-f1df62058b71 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:48.850109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07e3bd-4969-4580-86e1-a725a8b020e3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:48.873216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:48.874057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.874334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.874859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.884904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:48.886189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:48.886863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.887149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.887429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.888188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:48.888497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:48.889917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f39f7f49-046c-49e8-8a40-834dd1416eaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:48.892942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:48.893999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:48.894858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 32/69] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:58:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:48.897600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f0de-9bb2-4690-80a3-d870269065df None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.897929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f0de-9bb2-4690-80a3-d870269065df None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.898218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95f0de-9bb2-4690-80a3-d870269065df None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.903410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 38/70] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:48.903563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 33/71] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:48.903647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:48.903715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf537-5548-47a6-9f67-4621c5f2da85 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:48.903715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf537-5548-47a6-9f67-4621c5f2da85 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:48.903715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf537-5548-47a6-9f67-4621c5f2da85 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:48.903715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 34/72] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:48.906468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf537-5548-47a6-9f67-4621c5f2da85 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:48.978155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:48.980918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.001581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4037a-f2ab-4c55-ab81-6522b06af7b0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.010047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf537-5548-47a6-9f67-4621c5f2da85 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.035725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.036616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.036856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.037139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.044234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.044934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.045220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.045493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.046386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:49.046575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.048021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:49.048129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb53027-a729-4300-ae41-7802ca736c2e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:49.056530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:49.057526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 39/73] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:58:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:49.058479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.065007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 35/74] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:58:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.066308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ed69-8b64-406b-bc6b-06225d31c5d3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.066597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ed69-8b64-406b-bc6b-06225d31c5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.066880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ed69-8b64-406b-bc6b-06225d31c5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.083381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-41d2ed69-8b64-406b-bc6b-06225d31c5d3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:49.084575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-41d2ed69-8b64-406b-bc6b-06225d31c5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:49.150640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 36/75] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:49.152082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.152366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.152654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.162678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d57af7-01da-4edc-90b1-c5b781fd9e33 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.170075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:49.171273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:49.198887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.199852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.200199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.200483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.211067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.216997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.218661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.220352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 40/76] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.221130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.236787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.261823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 37/77] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:49.261823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.328336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d89cbf4-d4d2-4195-9203-98e59f0796dd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.347757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69068b1c-b0b9-45bc-bc42-249ed5607015 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.364082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.364758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.365050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.365331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.366643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:49.366955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.368360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.376917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 41/78] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.377953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.387754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.388075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.388377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.388634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.389860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.391308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.392940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 38/79] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.393706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.445933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.461156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.488554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af84d2-97c8-4323-9306-5d5969c2ec10 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.499050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860f2b50-c2bf-49c8-a200-9e7875b2f847 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.522941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.523660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.523943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.524218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.525388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.526846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.528465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 42/80] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.529229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.537335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.538571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.538856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.539135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.606706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.608185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.630428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c00084c-fbb2-4b46-8148-dbf21565af51 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.655614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.664263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.665038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.665321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.665603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.668233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.675969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:49.684164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:49.687166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 43/81] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:49.687918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.711832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 39/82] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:49.712685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.805014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d441207-2a6d-4c43-9d48-6bf83a700caf None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.823656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.824534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.824819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.825098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.826323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.827784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.829539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 44/83] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:49.830321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:49.841354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d74e1d-b7d6-4c49-aeed-9861b6fc5db4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.882235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.882890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.883176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.883458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.888457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.915642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:49.934020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca523519-02e4-45b7-9eab-14dd9e1a4091 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:49.955825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.957349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:49.970183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:49.970850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:49.971125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:49.971398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:49.972110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:49.973550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.056876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 40/84] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:50.057649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.066969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 45/85] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:58:49 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:50.068013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.136191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.181561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2838e8-e017-476b-9865-b3f6a8ba42ed None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.188576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57becca0-d116-4e17-8395-d9f80202f5a1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.200500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.228083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.228762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.229046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.229326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.230114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:50.230424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.231830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.235696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.236794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.236794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.236794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.238939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.241123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.241308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 41/86] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.245942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 46/87] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.246094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.246172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.379274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45905cf7-9854-43c0-8456-cfa30318a288 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.380287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4d6a9-e03a-4e03-b3fb-c27323bee16b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.414420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.416988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.418089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.418477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.418854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.420251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.420996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.421898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.427779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.427918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.427918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.428095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 47/88] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.428095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.475294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.501330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.503109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.531287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26af0f10-2cb2-4a47-8048-8e1dddd3942a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.567285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.568344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.568727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.569785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.570999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.572576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.574433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 48/89] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.575287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.611483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 42/90] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:50.612643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.638753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.688020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bd48c-bf33-4243-8ce5-56b2a6792542 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.703504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.724239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.725053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.725501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.725926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.726527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0409-89ef-47ac-b875-52d2eeaecc28 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.726969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:50.727382 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.728960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.736497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 49/91] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.742905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.767110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.768049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.768482 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.768902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.769983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:50.770493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:50.772294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:50.781113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 43/92] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:50.784414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:50.902324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b1dbf-4821-4560-8db6-e235361e9f41 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:50.966078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:50.981519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:50.982225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:50.982513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:50.982794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:50.984965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed70515-d637-4889-bff4-377fabd7016a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:51.047251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:51.048497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:51.048984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:51.049463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:51.051228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:51.053009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:51.055385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 44/93] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:51.065574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:51.067660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:51.083842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:51.091232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:51.191472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 50/94] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:51.200761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:51.218742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9741643-e9b3-4040-918f-62741a9366b9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:51.282099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:51.304151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9108c9-3afd-4502-9607-b69e56535171 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:51.319551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:51.320244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:51.320531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:51.320849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:51.321646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=f6d21cfc252e4afe8cc1bf635f18f2d8) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:51.321994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:51.323470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:51.341838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25474264-50d9-447e-a863-c56759db452b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:51.342920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474264-50d9-447e-a863-c56759db452b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:51.343371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474264-50d9-447e-a863-c56759db452b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:51.343786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25474264-50d9-447e-a863-c56759db452b None admin] PATH_INFO: `/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:51.344031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 45/95] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:58:51 2022] GET /identity/v3/role_assignments?user.id=f6d21cfc252e4afe8cc1bf635f18f2d8&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:51.345434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25474264-50d9-447e-a863-c56759db452b None admin] RBAC: Authorizing `identity:get_project(project_id=a5960a5a17ed47c29a3ad0a6753a5817)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:51.347114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25474264-50d9-447e-a863-c56759db452b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:51.349167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 51/96] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:51 2022] GET /identity/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:51.355378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:51.409808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:51.530208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86384297-92e9-4040-8e7a-e1a14efb4111 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:51.579555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:51.580238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:51.580521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:51.580802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:51.581650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=a5960a5a17ed47c29a3ad0a6753a5817, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:51.581995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:51.583520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb016b6-3123-4dfd-af65-3d6b710897e5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:51.594396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 46/97] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:58:51 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=a5960a5a17ed47c29a3ad0a6753a5817&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:52.654096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77a31-097e-43f7-b63a-2480d3ade0f6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:52.655132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77a31-097e-43f7-b63a-2480d3ade0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:52.655719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d77a31-097e-43f7-b63a-2480d3ade0f6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:52.657492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 52/98] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:52.664138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:52.664648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:52.664750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:52.687255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:52.688475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:52.789179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 47/99] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:52.824409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77a31-097e-43f7-b63a-2480d3ade0f6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:52.960608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d77a31-097e-43f7-b63a-2480d3ade0f6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:53.011424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:53.012248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.012537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.012899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.014206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:53.016445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d2b5b-6562-462c-a2f8-6e0766ca4f2c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:53.017697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 53/100] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:53.024432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:53.041440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:53.157751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823c1e5-7c24-4623-9e73-1b52d43bb557 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:53.210958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:53.210958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.210958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.210958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.217760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:53.217760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3b843-d628-4e38-bf41-f6feceecbc25 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:53.297806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 48/101] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 14:58:53 2022] POST /identity/v3/projects => generated 302 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:53.509359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32bd4-d922-4af5-a21c-4baf1b839163 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.509676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32bd4-d922-4af5-a21c-4baf1b839163 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.509900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a32bd4-d922-4af5-a21c-4baf1b839163 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.511268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 54/102] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:53.516920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c3f7-6721-4477-92f1-3844fe636ae4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.517211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c3f7-6721-4477-92f1-3844fe636ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.517490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b821c3f7-6721-4477-92f1-3844fe636ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.542799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b821c3f7-6721-4477-92f1-3844fe636ae4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:53.544017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b821c3f7-6721-4477-92f1-3844fe636ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:53.616125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:53.625076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 49/103] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:53.657161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a32bd4-d922-4af5-a21c-4baf1b839163 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:53.667691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871d32-e326-4ab3-b620-bc7efd244f52 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.668216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871d32-e326-4ab3-b620-bc7efd244f52 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.668216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62871d32-e326-4ab3-b620-bc7efd244f52 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.669621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 50/104] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:53.680039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.680881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.682134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:53.682779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.705404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:53.707644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:53.793947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 51/105] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:53.838401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a32bd4-d922-4af5-a21c-4baf1b839163 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:53.880085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:53.881176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:53.882238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:53.882696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:53.895178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:53.900079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:53.903329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:53.904228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:53.905013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 55/106] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:53.910120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.023846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.060890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e1cf-b39f-4e6d-a4a4-f0eec443c4a0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.064594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4db2c-5a08-4fbd-97ee-cc686e4b9094 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.105282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.106177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.106467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.106802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.117751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:54.128684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.129341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.129447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.129680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.129995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8533aed9-a729-4a70-8e0a-78d107394dab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:54.132955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:54.133811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:54.134566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 52/107] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:54.135663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24f7f5-00ff-4312-8fcc-a4a60069e2c4 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.135890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24f7f5-00ff-4312-8fcc-a4a60069e2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.136175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d24f7f5-00ff-4312-8fcc-a4a60069e2c4 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.137385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:54.137703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.139131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f46d71-1a4b-438e-8262-2c458eefef12 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.141145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 53/108] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:54.143182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24f7f5-00ff-4312-8fcc-a4a60069e2c4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.162330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 56/109] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:58:54.163918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.164269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.164636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.196608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:54.198272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:54.280326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d24f7f5-00ff-4312-8fcc-a4a60069e2c4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.336115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 57/110] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:54.338110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.349092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.350972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.351259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.351539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.353703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:54.354043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.357848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.374746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 54/111] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:54.375688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.477573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.490869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.540558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7963a15-3474-4b8c-9026-89a53b722373 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.582476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.583361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.583642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.583915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] PATH_INFO: `/v3/users/f359c26167ea435f83fd695241469e74` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.588925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767635b-d881-4413-b38a-39a5cf89a2ab None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.615362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] RBAC: Authorizing `identity:get_user(user_id=f359c26167ea435f83fd695241469e74)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.616887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.618671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 58/112] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/users/f359c26167ea435f83fd695241469e74 => generated 289 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:54.619438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.674623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.675273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.675717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.676133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.714704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:54.723274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:54.724205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:54.724955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:54.728224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 55/113] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:54.729284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.758670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa32fa-478b-4472-a688-874de84f8669 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.794325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.809414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.812625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.812625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.812625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.813794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.815256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.817245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 59/114] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:54.818146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:54.848678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908a49-44ab-40e0-a18d-fdccd74ac3d0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.858895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:54.886333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.887721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.888454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.889435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.934728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce25341-b783-4b57-a90a-fc81571d8454 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:54.967210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.968682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02dfde-71bd-417f-9e7b-ef090646a735 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.973696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:54.974395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.974679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.974963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.975750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:54.976061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:54.977451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37740a3e-fbe7-4af8-997b-b8a846086709 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 60/115] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e0b-529d-4cba-bcf9-c30ece9368ae None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e0b-529d-4cba-bcf9-c30ece9368ae None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d54e0b-529d-4cba-bcf9-c30ece9368ae None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 61/116] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:54.990605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54e0b-529d-4cba-bcf9-c30ece9368ae None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.051874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.096679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 56/117] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:55.098455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551152-c499-4ed7-9cab-6ab979eabf1e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.098976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551152-c499-4ed7-9cab-6ab979eabf1e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.099375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4551152-c499-4ed7-9cab-6ab979eabf1e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.105083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 57/118] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:55.106130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4551152-c499-4ed7-9cab-6ab979eabf1e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.117990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.120803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d54e0b-529d-4cba-bcf9-c30ece9368ae None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.162844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.163950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.164301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.164654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.165946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:55.167385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484414c-5e85-437f-8262-ddb4d87eff35 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:55.169200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 62/119] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:54 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:55.170467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.170792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.171046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.190052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:55.191256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:55.234440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4551152-c499-4ed7-9cab-6ab979eabf1e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.278281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 63/120] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:55.278612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.279456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.279739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.280015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.281250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:55.282735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a7a6c-a65c-4562-a271-370afb4e4d1d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:55.288768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 58/121] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:55.288891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.288992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.288992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.288992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.306048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:55.307242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:55.351406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.378920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 59/122] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:55.379730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.398016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.416974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f1ed1-c59b-42bb-a1fc-f31bf87446ed None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.457441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.460412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.460412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.460412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.461391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:55.462921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:55.467546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 64/123] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:55.468188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.515361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32552c76-27e0-4195-bb8c-94c8f5791c1a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.551873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.552756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.553041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.553924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.555922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, user_id=db788a4ba8014dbfb72bc12d8b2e5547, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:55.557392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:55.576372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b3514-b560-483e-b875-5113a29f2cc2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.596057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.610405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.611202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.611508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.611757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.612966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:55.614434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:55.616759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 65/124] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:55.616759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.627937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 60/125] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:58:55 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:58:55.629038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.714507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.759348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c72acd-37ea-4706-8ada-8d9746f9915d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.772340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb044450-07d5-413b-8f29-ff1349d36eda None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.816434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.817230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.817510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.817799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.822439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:55.823510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:55.824040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:55.824515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:55.830944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:55.837437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:55.839998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:55.840832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:55.841584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 61/126] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:55.842638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:55.851217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:55.852177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:55.852960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 66/127] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:55.853583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:55.930235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:55.974145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aded8-eb2e-4295-8729-87395b891756 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:55.987783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba34390-07c9-4a5e-80e3-f06af84e4102 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.009707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.022536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.023245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.028383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.028383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.028383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=f359c26167ea435f83fd695241469e74) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:56.028383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.028383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.032782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 62/128] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:58:55 2022] GET /identity/v3/role_assignments?user.id=f359c26167ea435f83fd695241469e74&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=55c434835fc84b63845ffff7c87ef345 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.033818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.039261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.040324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.040682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.041038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.047929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, user_id=db788a4ba8014dbfb72bc12d8b2e5547, role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.049550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.151558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 67/129] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:58:55 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/6e961f1500a848fe9f3cc181f375ddda => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:58:56.152981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.155612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ef457-0eb5-4062-999d-8d4751ddeb45 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.216439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.217056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.217392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.217679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.218528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:56.218940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.220425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e88f217-0903-4a7b-8dbc-b88c08b6a75a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.234187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 63/130] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.235829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13f37-619e-4e1a-bbb6-2866c5bc6ecc None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.236124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13f37-619e-4e1a-bbb6-2866c5bc6ecc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.236406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda13f37-619e-4e1a-bbb6-2866c5bc6ecc None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.237956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 64/131] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:56.239876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda13f37-619e-4e1a-bbb6-2866c5bc6ecc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.306435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.317873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbe6ed-e458-4155-b247-0b5dad7362c3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.347726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.361502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda13f37-619e-4e1a-bbb6-2866c5bc6ecc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.387620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.388315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.388602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.388886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.389650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:56.390109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.391686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a124be-cd42-460c-8821-c27c1869c5e8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.399409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.400289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.400631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.400910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.402210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.403930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.404265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 68/132] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.405624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.405782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 65/133] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.406003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.406267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.410449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.424811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:56.426060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:56.504983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 69/134] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:56.510060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.521613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552249c0-2699-4e50-9458-7b9321546a17 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.543225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.574453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.575507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.575895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.576273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.582472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.584073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.586670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 66/135] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.587356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.642188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.645429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fe7c38-5308-4e3a-abfe-dc7b8131ba9b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.682281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.683448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.683987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.684566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.685807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.687475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.689421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 70/136] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.689998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.797770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30ad04-45d4-491a-8e80-71fd0ba93d66 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.825503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe026e-be71-482f-9468-c09788c49f56 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.835279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.836149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.836431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.836712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] PATH_INFO: `/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.838029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] RBAC: Authorizing `identity:get_project(project_id=a5960a5a17ed47c29a3ad0a6753a5817)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.839605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.841491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 71/137] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.842286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.881843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:56.901659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.902497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.902784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.903069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:56.904274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:56.905783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:56.907474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 67/138] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:58:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:56.908231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:56.960200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3434fe-1978-42f0-a95f-0bece4364f46 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:56.996948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:56.997879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:56.998171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:56.998467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/f6d21cfc252e4afe8cc1bf635f18f2d8/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:57.000718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, user_id=f6d21cfc252e4afe8cc1bf635f18f2d8, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:57.002281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:57.033340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:57.082627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d51b6c-bdb7-46d1-b14d-1f843ef5454b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:57.091727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 72/139] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:58:56 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/f6d21cfc252e4afe8cc1bf635f18f2d8/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:58:57.092324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:57.128690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:57.130172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:57.131477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:57.132239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] PATH_INFO: `/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:57.139791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] RBAC: Authorizing `identity:create_grant(project_id=a5960a5a17ed47c29a3ad0a6753a5817, user_id=db788a4ba8014dbfb72bc12d8b2e5547, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:57.142760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf18728-882b-4fb7-94a5-37bfe7798570 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:57.217106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 68/140] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:58:56 2022] PUT /identity/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817/users/db788a4ba8014dbfb72bc12d8b2e5547/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:58:57.277205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:57.284374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d2fc-01e2-475b-bd71-c928ca5b975b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:57.329458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:57.330194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:57.330478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:57.330758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:57.331487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:57.333071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf4087-8d79-4ba9-80a5-9f807c191109 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:57.451409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 73/141] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:58:57 2022] POST /identity/v3/users => generated 283 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:58:58.067397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344dd0f-5ea0-4187-b145-0167fc56aac7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.067908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344dd0f-5ea0-4187-b145-0167fc56aac7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.067981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344dd0f-5ea0-4187-b145-0167fc56aac7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.070237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 69/142] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:58.080396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.080875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.080945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.102779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:58.103993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:58.186429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 74/143] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:58.213301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344dd0f-5ea0-4187-b145-0167fc56aac7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:58.347393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344dd0f-5ea0-4187-b145-0167fc56aac7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:58.368494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:58.388017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:58.388827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.389114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.389395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.406810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:58.414600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:58.415473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:58:58.416225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:58:58.416785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 70/144] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:58.422253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:58.549246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:58.578973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb23926-819e-4012-847e-bc6ba916c629 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:58.639564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:58.640660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.641146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.641631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.643059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:58.643602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:58.646116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e3997-4fcb-4f10-b8f3-cf3b81bce8bd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:58.661886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 75/145] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:58.670479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:58.863611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa84b36-4298-47bc-943c-fa1cdf71145e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:58.880719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35bfb-303d-4524-8e60-5d2b7b734dfa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.881561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35bfb-303d-4524-8e60-5d2b7b734dfa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.881803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca35bfb-303d-4524-8e60-5d2b7b734dfa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.883198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 76/146] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:58.888542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239a002-9e43-4d51-a772-55650758b7e7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.888807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239a002-9e43-4d51-a772-55650758b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.889147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239a002-9e43-4d51-a772-55650758b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.914403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f239a002-9e43-4d51-a772-55650758b7e7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:58.915547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f239a002-9e43-4d51-a772-55650758b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:58.942984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:58.944501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:58.944783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:58.945058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:58.946455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:58.947910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:58.951047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 71/147] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:58:58 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:58.959859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.046780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:59.052660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 77/148] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:58:59.054643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f22e-7c5b-4a46-b4b6-e7f4f4814107 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.054929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f22e-7c5b-4a46-b4b6-e7f4f4814107 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.055207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f22e-7c5b-4a46-b4b6-e7f4f4814107 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.056681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 78/149] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:58:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:58:59.065761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.066990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.066990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.096243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:58:59.098373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:58:59.168211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db707302-4fb0-4340-a193-fefe13d40c82 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:59.176327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 79/150] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:58:59.177471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.186901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:59.238519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:59.239209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.239466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.239745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.366241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f0302-07a7-42a2-b2fb-b23d273275e8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:59.368617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:59.370139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:59.433507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:59.434266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.434542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.434812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.455367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:59.455687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:59.463873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:59.465852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 80/151] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:58:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:59.466984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.558863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 72/152] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:58:59.559567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.596670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:58:59.686859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cc06e-c2fb-4540-919a-96b15c9be65b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:59.750414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba27bb6-d167-44a1-accd-c2de4d679026 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:58:59.760728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:59.761535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.761886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.762164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.790629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:58:59.798379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:58:59.799442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 81/153] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:58:59.800746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.826390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:58:59.827071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:58:59.827354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:58:59.827629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:58:59.828759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:58:59.829071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:58:59.830840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:58:59.849311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 73/154] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:58:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:58:59.851089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:58:59.865006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:00.017683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fc037-b293-4d53-939a-4549e5d942a8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.030893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dce07-e7ac-4ef1-9d9a-800b38f41f10 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.069811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.070630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.070918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.071200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.072219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:00.072531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.073960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.075089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:00.093494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 74/155] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.094447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:00.113020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.113978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.114267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.114530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.118481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.120054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.122020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 82/156] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:58:59 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.122696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:00.228037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:00.294381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa85027b-d402-4bbe-93de-24f5b8c979af None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.356184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.357115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.357992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.358457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.359941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.360448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e1879-081a-432d-aeaf-f4abda01a16e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.361392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.367856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 75/157] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:00 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.368808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:00.445669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.446638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.446918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.447195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] PATH_INFO: `/v3/users/f359c26167ea435f83fd695241469e74` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.448529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] RBAC: Authorizing `identity:get_user(user_id=f359c26167ea435f83fd695241469e74)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.450022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.451703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 83/158] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:00 2022] GET /identity/v3/users/f359c26167ea435f83fd695241469e74 => generated 289 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.452481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:00.564537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92362fae-e615-48dc-a401-e3634311c0b9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.567090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:00.631894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.632551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.632834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.633156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.634027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:00.635089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.636538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.640692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:00.643312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbe56d9-5dc3-4e84-a0d7-3026bcf795a0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.647735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 76/159] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:00 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.653017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:00.698440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.699104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.699389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.699713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.858865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.860377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a279be7-b783-4ed0-af69-93e498646de4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.876232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1b208e-15f4-43df-b687-bccc46c88f74 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:00.937884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:00.938810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.939091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.939366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.940625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:00.942116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a4713-78c9-4a3f-afdb-cba3c4ee2dcf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:00.944376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 77/160] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:00 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:00.945589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe944c-1d51-4531-8685-51c93bd36159 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:00.945923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe944c-1d51-4531-8685-51c93bd36159 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:00.946203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe944c-1d51-4531-8685-51c93bd36159 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:00.947460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 78/161] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:00.951303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe944c-1d51-4531-8685-51c93bd36159 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.025783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.031729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.063511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe944c-1d51-4531-8685-51c93bd36159 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.078899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 84/162] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:01.080265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.080555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.080838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.103563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.104542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.104824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.105095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/f359c26167ea435f83fd695241469e74/roles/55c434835fc84b63845ffff7c87ef345` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.107361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, user_id=f359c26167ea435f83fd695241469e74, role_id=55c434835fc84b63845ffff7c87ef345)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:01.108976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:01.110926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:01.112191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:01.187590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 85/163] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:01.188387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.191738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 79/164] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:00 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/users/f359c26167ea435f83fd695241469e74/roles/55c434835fc84b63845ffff7c87ef345 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:59:01.241312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.318213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.327970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7f7208-005c-4df6-b3d9-a91f0e863b8e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.387736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.388616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.388898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.389180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.390758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:01.392272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e980f3b-3930-4e7e-9cbf-cd7a42a546be None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:01.392944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f04fed-1b6e-436d-9595-e45cff3d4871 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.394158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 86/165] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:01.403325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079d271-24fc-4273-aa94-0f6a781c5ba3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.403629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079d271-24fc-4273-aa94-0f6a781c5ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.403890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3079d271-24fc-4273-aa94-0f6a781c5ba3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.405373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 87/166] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:01 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:01.406156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079d271-24fc-4273-aa94-0f6a781c5ba3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.423136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.432724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.433520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.433832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.434116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.446627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a5f514bc-d7bb-4c01-9325-618e516d243a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:01.454475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:01.455410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:01.456765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 80/167] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:01.457422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.457422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.457535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.482686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:01.483908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:01.560657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 81/168] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:01.561511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.588148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3079d271-24fc-4273-aa94-0f6a781c5ba3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.656662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.657305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.657589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.657912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.659251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:01.659883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:01.661848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:01.673686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 88/169] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:01.674383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71a29a-c88a-462d-acc2-b9cb8d4115e2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.674491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.706805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.727887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.728865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.730113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.730539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.731679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:01.732291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:01.734262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:01.735317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:01.748711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 82/170] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:01.755517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:01.926773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34d8c2-821f-4ab6-bb44-a8075eff54a5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.939972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91a84b0-672f-4c16-a2ec-6aa10245adbc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:01.964049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:01.964935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:01.965219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:01.965500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] PATH_INFO: `/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:01.966770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] RBAC: Authorizing `identity:get_user(user_id=f6d21cfc252e4afe8cc1bf635f18f2d8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:01.968390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:01.970403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 83/171] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/users/f6d21cfc252e4afe8cc1bf635f18f2d8 => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:01.976490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.040449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.041258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.041536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.041872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.043743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:02.071486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:02.084431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:02.085371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:02.086233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 89/172] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 412 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:02.092692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.098485 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d4d1f-fa78-4a0c-989c-29a4543a627e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:02.150004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.150663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.150943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.151214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.194576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:02.219568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991a35f-0e63-4512-9250-48abb6dafd95 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:02.229137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:02.230949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:02.266961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.267961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.268407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.268846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.269928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:02.270408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:02.272160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec1574-41f6-44a3-84a1-1643008447db None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:02.281269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 90/173] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:02.287774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e44a-5804-4222-8675-d9b4d2f0902c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.288274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e44a-5804-4222-8675-d9b4d2f0902c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.288719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448e44a-5804-4222-8675-d9b4d2f0902c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.290030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:02.290825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 91/174] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:02.296665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.297217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.297650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.315867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:02.317593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:02.354377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 84/175] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:59:02.355258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.394988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 92/176] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:02.403342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.480231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9279b-b823-4022-9c95-e862e0132bfd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:02.512627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:02.521544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.522820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.523092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.523371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] PATH_INFO: `/v3/users/db788a4ba8014dbfb72bc12d8b2e5547` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.525128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=db788a4ba8014dbfb72bc12d8b2e5547)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:02.526734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:02.532960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 85/177] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/users/db788a4ba8014dbfb72bc12d8b2e5547 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:02.532960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.552237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:02.561007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0a429-af30-4143-9c1e-5f541ec6ad63 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:02.601546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.602832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.603523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.604108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.605640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:02.607414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:02.609463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 93/178] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:02.610615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:02.655617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be0b6a-4a17-48ae-a2ad-d25dac1ea2b3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:02.694083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:02.695361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:02.696520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:02.696800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:02.712546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:03.031871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:03.032813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 86/179] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:03.033632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.034646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.034646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a53c0d-e457-482f-8803-88985227c872 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.034783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7639dcb-3676-4a92-9f2c-dcc9a88df22c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.034866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.034866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.034866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.034866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.035126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=f6d21cfc252e4afe8cc1bf635f18f2d8) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:03.035126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.035126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.035126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 87/180] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/role_assignments?user.id=f6d21cfc252e4afe8cc1bf635f18f2d8&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:03.035126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.035425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.035425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.035425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.035425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.035679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.035751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1941c7-8417-438b-b1ef-f14e35c654b4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.149131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.149357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.149559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.150497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.150614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:03.150943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.156408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcad0f-3ae2-4fcd-9a8e-5bb834ad20a1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.172594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 88/181] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:03.174193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44446-9963-49eb-8a1c-a432f3d56bc5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.174193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44446-9963-49eb-8a1c-a432f3d56bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.174415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed44446-9963-49eb-8a1c-a432f3d56bc5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.175664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 89/182] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:03.176744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184e7c9-c69a-4a35-8837-ee4b52bd1a92 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.178373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.179893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf58790d-2e52-464a-8d76-1d9a9f8d2d17 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.182519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184e7c9-c69a-4a35-8837-ee4b52bd1a92 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.184166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184e7c9-c69a-4a35-8837-ee4b52bd1a92 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.188388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 90/183] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:03 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:03.189062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184e7c9-c69a-4a35-8837-ee4b52bd1a92 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.195114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.309081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 94/184] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 697 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:03.311162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.311453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.311732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.328951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:03.330169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:03.330754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184e7c9-c69a-4a35-8837-ee4b52bd1a92 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.364416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.365863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.366144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.366415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.369054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.382818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.388871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443efd10-c458-419d-8cc2-7c823c39f2d7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.388871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 91/185] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:03.388871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.388871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.388871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.405360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:03.406606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:03.417981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 95/186] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:03.417981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.484873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.498026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 92/187] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:03.499499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.531585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38934db3-edd9-43d4-b1f1-042efa0e8ac6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.570912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.571974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.571974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.572251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] PATH_INFO: `/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.573396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] RBAC: Authorizing `identity:get_project(project_id=a5960a5a17ed47c29a3ad0a6753a5817)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.574879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.576587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 96/188] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/projects/a5960a5a17ed47c29a3ad0a6753a5817 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:03.581457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.608493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f8d566-2eb7-4fc0-87de-b1d0ad56c3cf None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.624532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.646108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.647756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.647756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.647982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.686422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e5c5d4-fc26-44d4-a97f-6b91a9cc36fe None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.707588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.718802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.721167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.722559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.723383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.723664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.723937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.735108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:03.743261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:03.744334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 97/189] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:03.750395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.838030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 93/190] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:03.838030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.861865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.864750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e6bb3f-6fb3-4c30-b581-2c575a774adc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.901393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.902313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.902663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.903013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.904290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.905869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:03.907812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 98/191] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:03.908440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:03.937950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:03.948603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3089837-0bae-4ad7-95c6-c13a20a140a8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:03.985851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98854637-072a-47b1-8408-f68305667387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:03.986608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854637-072a-47b1-8408-f68305667387 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:03.986954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854637-072a-47b1-8408-f68305667387 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:03.987296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98854637-072a-47b1-8408-f68305667387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:03.988198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98854637-072a-47b1-8408-f68305667387 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=a5960a5a17ed47c29a3ad0a6753a5817, user.id=db788a4ba8014dbfb72bc12d8b2e5547) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:03.988590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98854637-072a-47b1-8408-f68305667387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:03.990258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98854637-072a-47b1-8408-f68305667387 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.006159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 94/192] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/role_assignments?user.id=db788a4ba8014dbfb72bc12d8b2e5547&scope.project.id=a5960a5a17ed47c29a3ad0a6753a5817&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.006159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98854637-072a-47b1-8408-f68305667387 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.023539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e69fe-f685-494c-bd2a-13b8b4b33b17 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.067276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.067956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.068744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.069017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.069833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:04.070638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.072104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.081144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 99/193] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.082017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.118101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.123925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98854637-072a-47b1-8408-f68305667387 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.162607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.163564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.163738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.164012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.166480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.167951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d9e0-e356-4e97-92fd-d554ade66e7e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.169681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 95/194] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:03 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.170929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bfc-e772-4860-8866-67cc53910168 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.171197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bfc-e772-4860-8866-67cc53910168 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.171472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d5bfc-e772-4860-8866-67cc53910168 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.172856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 96/195] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:04.173422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d5bfc-e772-4860-8866-67cc53910168 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.202531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.210526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c41560-be94-4b98-93ea-27e981e9f90f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.249263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.249986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.250270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.250544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.251260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.252713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290406-abc7-45a6-8ee8-085b60d3269f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.296136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d5bfc-e772-4860-8866-67cc53910168 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.328869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.329737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.330020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.330285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.331458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.332875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.334565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 97/196] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.339446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.363932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 100/197] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:04 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:04.375529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.375739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.375987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.397865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:04.405880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:04.434741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.446225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd2aab4-e400-4fda-80c0-c55ace45f6b0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.478167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 101/198] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:04.479392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.499287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.501280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.502321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.502820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.503389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.504468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=b3d327a30f0d4bbbb1c4f154b11225d2) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:04.504983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.507231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.513389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 98/199] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/role_assignments?user.id=b3d327a30f0d4bbbb1c4f154b11225d2&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.514303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.618293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6233a-69d0-4db7-aa99-55d185bf54f1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.670278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42676e-a38a-494a-8a2c-22fe120aa137 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.682462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.684022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.684337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.684619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.720314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.720684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.720976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.721249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.736260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:04.747233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:04.748162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:04.749227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 99/200] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:04.754553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.771116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.772907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.775101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.799098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:04.874762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d4377a-28d3-40d8-875d-b5dbf270f1a6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:04.914541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 102/201] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:04.921773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:04.926078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:04.927033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:04.928062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:04.928538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:04.929510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:04.930039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:04.932267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:04.945226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 100/202] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:04.951323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:05.055777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:05.080850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa368c2-2247-43be-be8d-12b2ce95599c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:05.083890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef7f62-c68c-497e-bde3-078e2025a183 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:05.106311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:05.134962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:05.136242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:05.138399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:05.138891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] PATH_INFO: `/v3/users/f359c26167ea435f83fd695241469e74` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:05.141503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] RBAC: Authorizing `identity:get_user(user_id=f359c26167ea435f83fd695241469e74)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:05.143741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:05.146134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 101/203] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/users/f359c26167ea435f83fd695241469e74 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:05.148340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:05.149453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:05.154154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:05.154442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:05.155527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:05.155777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:05.157359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:05.159160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 103/204] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:04 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:05.167898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:05.321668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0eedf4-e434-4080-987c-fb02f0556b4e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:05.345427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba08fb-dc8d-4082-82e8-bfcd07d0d84b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:05.375198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:05.375867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:05.376149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:05.376420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:05.377270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=b3d327a30f0d4bbbb1c4f154b11225d2) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:05.377580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:05.379114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:05.397802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:05.398728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:05.399154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:05.399587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:05.401660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 104/205] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:05 2022] GET /identity/v3/role_assignments?user.id=b3d327a30f0d4bbbb1c4f154b11225d2&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:05.417472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:05.499207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:05.500946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:05.641634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 102/206] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:05.649861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:05.720995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:05.780047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8599ae7-e3a3-4c20-8107-f6504ec67256 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:05.824850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:05.825992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:05.826451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:05.826871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:05.828240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:05.829867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15bca4-b22b-4e1b-87db-b679aa789a18 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:05.831733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 105/207] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:05 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:05.838226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:05.897071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:05.965038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ea1e8-8109-490a-9779-df7eb0200269 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:06.012699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:06.013577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:06.014055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:06.014490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:06.015461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, scope.project.id=b38d09dcccf44384910345b56cbf0d87, user.id=f359c26167ea435f83fd695241469e74) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:06.015914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:06.017498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edf473-b9fa-4413-938a-756c3dab006a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:06.024519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 103/208] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:05 2022] GET /identity/v3/role_assignments?user.id=f359c26167ea435f83fd695241469e74&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=55c434835fc84b63845ffff7c87ef345 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:06.758426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6583-6d32-4013-bcda-1998e897b4ed None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:06.758958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6583-6d32-4013-bcda-1998e897b4ed None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:06.758958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a6583-6d32-4013-bcda-1998e897b4ed None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:06.760509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 106/209] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:06.765987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:06.766407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:06.766574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:06.784666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fb2f-06ba-42d7-9186-8e5ff686ca79 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:06.784992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fb2f-06ba-42d7-9186-8e5ff686ca79 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:06.785227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368fb2f-06ba-42d7-9186-8e5ff686ca79 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:06.787287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 107/210] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:06.789755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:06.791178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:06.798601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:06.798923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:06.799136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:06.816518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:06.817840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:06.878154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 104/211] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:06.896726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 108/212] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:06.900333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:06.922309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:06.943294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:06.979090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.008704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacba42f-ff59-4a2d-a53b-9410eb09ad15 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.041870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be29524-d46f-4769-ad1a-2c5e6020de8e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.047688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.048487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.048765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.049035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.063440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:07.073758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:07.074794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:07.075575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 105/213] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:07.080955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.084715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.085756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.086213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.086659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.098601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:07.107639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:07.108522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:07.109321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:07.111480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 109/214] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:07.118228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.201084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.211413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79232aa-7b8f-4cdd-bdbb-b5f0f30ea2aa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.249586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.250270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.250547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.250817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.251553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:07.251855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.253235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f25642-8f4f-4df1-b1c6-799b0221ea09 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.254935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2c2cc-5cf2-4fcf-b8ee-dd3e4b3c56dc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.262053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 106/215] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:07.263093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbccf-8bcb-4756-8f6e-665e533ede02 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.263384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbccf-8bcb-4756-8f6e-665e533ede02 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.263670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bbccf-8bcb-4756-8f6e-665e533ede02 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.265058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 107/216] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:07.269108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.270305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bbccf-8bcb-4756-8f6e-665e533ede02 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.297726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.298525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.298873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.299151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.299913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:07.300201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.301563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb6478-322b-4915-b77e-9d5c6db1835f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.310655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 110/217] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:07.311900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.312183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.312454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.329163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:07.330333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:07.386659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bbccf-8bcb-4756-8f6e-665e533ede02 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.400403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 111/218] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:07.403446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.424743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.425647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.425950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.426235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.428063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.429510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.431187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 108/219] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:07.434602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.466126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.514767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.520049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e226fc7-de0c-4bfc-ad4a-3c8d4d3fd321 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.543820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b620957-4d58-47b7-a59f-9a91cad8bdf7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.559115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.559999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.560279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.560552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] PATH_INFO: `/v3/users/2e037839ee804d6998fe17bf7ea0952b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.574384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] RBAC: Authorizing `identity:get_user(user_id=2e037839ee804d6998fe17bf7ea0952b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.575862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.577589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 112/220] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/users/2e037839ee804d6998fe17bf7ea0952b => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:07.582001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.585481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.586372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.586656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.586926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.588112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.589588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.591260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 109/221] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:07.592103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.692227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.698302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcd235-2780-4de2-b1af-c2cdabccca3d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.698890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb6c1d-02c5-4628-bc4a-207d8cf883d0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.733877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.734229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.734733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.734879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.735045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.735149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.735294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.735383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.736445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.737979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.744835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 113/222] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:07.744835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.771351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.808251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.809742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.850427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba0276-7004-420f-b45f-b56326ed734b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:07.885893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:07.886622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:07.886905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:07.887246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:07.887961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:07.889419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:07.906930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:07.914086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 110/223] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:07.914891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:07.998130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 114/224] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:07 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:07.999223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:08.012748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25035e-be6e-4205-96d7-54d4548907a7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.054226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.055050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.055328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.055600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/b3d327a30f0d4bbbb1c4f154b11225d2/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.057768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, user_id=b3d327a30f0d4bbbb1c4f154b11225d2, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:08.059272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87982d0-ba34-4efa-85f9-3cc0c9378d34 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:08.091729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:08.112198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6fbb6-bfc1-450f-9e54-a81c2bdb1013 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.128579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 111/225] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:07 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/b3d327a30f0d4bbbb1c4f154b11225d2/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:08.130195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b1d-5fe7-4659-9150-308de81b3a31 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.130508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b1d-5fe7-4659-9150-308de81b3a31 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.130783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f530b1d-5fe7-4659-9150-308de81b3a31 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.132259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 112/226] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:08.138380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3246-8028-4d65-985e-e30303824643 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.138674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3246-8028-4d65-985e-e30303824643 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.138960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb3246-8028-4d65-985e-e30303824643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.160957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8afb3246-8028-4d65-985e-e30303824643 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:08.163010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8afb3246-8028-4d65-985e-e30303824643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:08.167029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.168290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.168747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.172587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.172587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:08.172587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:08.174098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 115/227] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:07 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:08.181120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:08.234473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:08.256065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 113/228] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:08.281155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3246-8028-4d65-985e-e30303824643 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:08.317137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b94a7-ddef-41be-a55e-b08e81471aeb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.366532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.367195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.367474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.367748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.368584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=2e037839ee804d6998fe17bf7ea0952b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:08.368891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:08.370612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:08.377587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 116/229] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:08 2022] GET /identity/v3/role_assignments?user.id=2e037839ee804d6998fe17bf7ea0952b&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:08.411673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb3246-8028-4d65-985e-e30303824643 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.453614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.454918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.455402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.455876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.469691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:08.480695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:08.481681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:08.482525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:08.485505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 114/230] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:08.491992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:08.511206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:08.626811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad775af-0e70-45a9-b19b-6323346103d7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.674465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.675165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.675449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.675726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.676495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:08.676801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:08.678781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:08.688117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 117/231] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:08.694146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:08.759447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:08.815916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296786a7-a028-4a10-825b-2652d5c27d38 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:08.852427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:08.853647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:08.854174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:08.854669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:08.856126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:08.857814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:08.859674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 115/232] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:08 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:08.871023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:09.002740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:09.027711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86dc15-0632-4326-a52f-dccdb0951c25 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:09.063043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:09.063922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:09.064203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:09.064484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:09.065703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:09.067209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9455dc-beee-45ab-91b9-8140e50f59e4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:09.069269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 118/233] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:08 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:09.074921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:09.188839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6343df54-48e7-4a7f-9cee-1575dec410e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:09.206685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:09.232177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:09.233131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:09.233588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:09.233903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/b3d327a30f0d4bbbb1c4f154b11225d2/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:09.236193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, user_id=b3d327a30f0d4bbbb1c4f154b11225d2, role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:09.237800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d551a-1047-4184-9645-f326f51ea732 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:09.327131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 116/234] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:09 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/b3d327a30f0d4bbbb1c4f154b11225d2/roles/6e961f1500a848fe9f3cc181f375ddda => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:10.703546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3991c-bf45-4ef2-b0db-302db9526fe7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.704559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3991c-bf45-4ef2-b0db-302db9526fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.705090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3991c-bf45-4ef2-b0db-302db9526fe7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.706981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 119/235] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:10.711915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef6f2-e87e-47dd-8a01-c78b482cebe6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.712727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef6f2-e87e-47dd-8a01-c78b482cebe6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.713222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fef6f2-e87e-47dd-8a01-c78b482cebe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.738743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d5fef6f2-e87e-47dd-8a01-c78b482cebe6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:10.740845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d5fef6f2-e87e-47dd-8a01-c78b482cebe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:10.766048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac8f-ef89-42b0-9687-10e2a844f6f9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.766347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac8f-ef89-42b0-9687-10e2a844f6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.766608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fac8f-ef89-42b0-9687-10e2a844f6f9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.768123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 120/236] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:10.779534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18354-44e0-4b3e-a7de-b097ebd19df0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.779819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18354-44e0-4b3e-a7de-b097ebd19df0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.780097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba18354-44e0-4b3e-a7de-b097ebd19df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.818775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fba18354-44e0-4b3e-a7de-b097ebd19df0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:10.820001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fba18354-44e0-4b3e-a7de-b097ebd19df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:10.830720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 117/237] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:10.852536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d371-6f0e-4137-93b4-233fe9eeaaad None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.852825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d371-6f0e-4137-93b4-233fe9eeaaad None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.853106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d371-6f0e-4137-93b4-233fe9eeaaad None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.854620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 118/238] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:10.863535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09d371-6f0e-4137-93b4-233fe9eeaaad None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:10.908664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 121/239] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:10.917751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:10.917751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:10.917751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:10.933776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:10.933776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:11.015762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 122/240] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:11.015762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.016622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.029987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09d371-6f0e-4137-93b4-233fe9eeaaad None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.032493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.066180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.066974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.067256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.067531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.078664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:11.086569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:11.087462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 119/241] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:11.093205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.143250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad734dd-fe4f-4303-8c63-ca2651994390 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.179245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.180038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.180315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.180584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.190776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:11.197250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03bf753-a051-4321-bb00-b5263e8ec74e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-710b5c85-66ee-4ebf-a12e-ffb5c6bd9419 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:11.198466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:11.199375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:11.200311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:11.204632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 123/242] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:11.206062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6f110-8368-4f8d-8151-ab50a10eb855 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.206353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6f110-8368-4f8d-8151-ab50a10eb855 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.206631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b6f110-8368-4f8d-8151-ab50a10eb855 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.212716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 124/243] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:11.212716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6f110-8368-4f8d-8151-ab50a10eb855 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.246831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.247714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.248050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.248591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.249762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.251419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.253047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 120/244] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:11.257738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.284254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.287796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.329901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b6f110-8368-4f8d-8151-ab50a10eb855 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.365981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ecad2-3d8d-4a5a-a1bd-0821977133ba None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.366533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.367211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.367499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.367763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.368917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:11.368917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.370261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220fbcb-39b0-44fb-ad55-e96cb01feea5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.379643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 125/245] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:11.381830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.382077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.382351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.402878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:11.404094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:11.411739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.412986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.413272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.413574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.415020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:11.415273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.417389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.429963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 121/246] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:11.434888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.479055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 126/247] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:11.479848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.545655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.547989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.555327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9a6de-b410-4926-a08a-6d712ecd3214 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.589847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.590517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.590804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.591084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.591785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.593248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.594609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9b48-5345-4ddc-9dee-cd3b7a4d0853 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.632095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.633070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.633423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.633779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.634978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.636466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.638131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 127/248] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:11.638131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.661635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 122/249] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:11 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:11.664250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.775823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d61572-79f1-442b-8dd1-21874bb97650 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.795834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b326652a-98d7-4245-b960-f2f64c23f768 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.801711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.815142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.816019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.816370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.816660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] PATH_INFO: `/v3/users/01af11234c034f49a4572ad7d81c8b77` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.832685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] RBAC: Authorizing `identity:get_user(user_id=01af11234c034f49a4572ad7d81c8b77)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:11.834248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:11.836149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 128/250] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/users/01af11234c034f49a4572ad7d81c8b77 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:11.836778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.845762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:11.845762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:11.845762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:11.845762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:11.862291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:11.873425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:11.874446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:11.875233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 123/251] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:11.875884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:11.889957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:11.961308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0037-5d21-4ea2-bfc5-6e57fe3a45fe None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:11.988770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabcd23-c411-41f1-9c32-a4075afb8bfa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.001390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.002075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.002360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.002633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.032281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.032930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.033250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.033478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.066916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.095028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.096752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505711ef-e774-434e-8ac7-93391409ebf1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.112946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.115347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.127674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.210393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 129/252] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:12.212067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13df7b-3df5-425e-8c22-123af8ed7679 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.212589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13df7b-3df5-425e-8c22-123af8ed7679 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.213096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13df7b-3df5-425e-8c22-123af8ed7679 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.219217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 130/253] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:12.219462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 124/254] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:12.220576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13df7b-3df5-425e-8c22-123af8ed7679 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.222612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.337934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.355300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c20e8-42c2-47ba-9b9c-38fa9d5eebe3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.367178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13df7b-3df5-425e-8c22-123af8ed7679 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.368528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.398427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.400014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.400302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.400631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.401394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:12.401699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.403919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d3396c-e525-4bf9-936c-ea4280b79706 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.408126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.409315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.409846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.410378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.412459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.418444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 125/255] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:12.418444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.418444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.418444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.419568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.422081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 131/256] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:12.423272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.470355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:12.471641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:12.562322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 126/257] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:12.563573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.570701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7bde3-c485-458e-82ad-8fcbd05bd85d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.626333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.627897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.628357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.629121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.630946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.633460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.637313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 132/258] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:12.638313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.672361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.704311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5009f793-fda8-402b-b083-97794aa54b26 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.705932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:12.742478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.743458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.743741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.744014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] PATH_INFO: `/v3/users/2e037839ee804d6998fe17bf7ea0952b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.745205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] RBAC: Authorizing `identity:get_user(user_id=2e037839ee804d6998fe17bf7ea0952b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.746679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.748577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 127/259] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/users/2e037839ee804d6998fe17bf7ea0952b => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:12.749432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.779640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a94b41-f9ae-4e3e-9f5a-8ec08b289d63 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.817174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.818634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.818921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.819569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.820117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=b3d327a30f0d4bbbb1c4f154b11225d2) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:12.820428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:12.821893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:12.828441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 133/260] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/role_assignments?user.id=b3d327a30f0d4bbbb1c4f154b11225d2&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:12.829285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.873865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7f685-01c2-4173-bf36-c2f5731720a1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:12.924569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:12.925322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:12.925601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:12.925900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:12.953633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:12.962532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:12.963490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:12.964265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 128/261] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:12.964904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:12.965975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.011623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f83c8-9f12-458e-bb5d-6a3fff69c853 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.015167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.075329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.076405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.076941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.077411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.079444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=01af11234c034f49a4572ad7d81c8b77) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:13.080143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.081909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.093612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 134/262] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/role_assignments?user.id=01af11234c034f49a4572ad7d81c8b77&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=55c434835fc84b63845ffff7c87ef345 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:13.094580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:13.162527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2ec62-4c27-4bd5-a555-ccb67b7e0a03 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.218265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde73013-ce31-48ca-a1a5-a9087532d33b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.259692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.260383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.260666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.260939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.261709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:13.262041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.263773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.272973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 135/263] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:13.278488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:13.282483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.283374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.283657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.283932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.286037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.287607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.293490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 129/264] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:12 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:13.298161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.308148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:13.397036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651992d8-3f03-4608-a39f-1ae26eb6472f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.435531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.436893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.437173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.437445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] PATH_INFO: `/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.439346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] RBAC: Authorizing `identity:get_user(user_id=b3d327a30f0d4bbbb1c4f154b11225d2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.440992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.443628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 136/265] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:13 2022] GET /identity/v3/users/b3d327a30f0d4bbbb1c4f154b11225d2 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:13.449592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:13.554303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.567298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb69da-39cd-4993-8c63-d73020df53cd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.606172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.606965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.607384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.607694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.627724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.643768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0012be45-823c-4daf-8555-bf27ec042004 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.705018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.707256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.719828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.720840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.721126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.721403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/2e037839ee804d6998fe17bf7ea0952b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.724203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, user_id=2e037839ee804d6998fe17bf7ea0952b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:13.725684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:13.788796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:13.815882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 137/266] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:13.820612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 130/267] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:13 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/2e037839ee804d6998fe17bf7ea0952b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:13.821267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:13.933420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4d3a7-6efa-4fd6-80e1-db46d9b8c5b9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:13.989180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:13.990501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:13.990996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:13.991464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:13.999049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:14.000937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8351ed-b8fb-4888-a80a-99b249aa3470 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:14.003477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 138/268] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:13 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:14.009646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.138551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e086a0-dfca-4e34-b43c-2c1655965f22 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:14.170003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be51f-0f6d-432d-af96-d92f3ca1d1a9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.170318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be51f-0f6d-432d-af96-d92f3ca1d1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.170569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30be51f-0f6d-432d-af96-d92f3ca1d1a9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.171956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 139/269] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:14.177244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.177529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.177634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:14.177837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.178233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.178514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.178793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.179743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=b3d327a30f0d4bbbb1c4f154b11225d2) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:14.180161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:14.181832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f82a6-c166-4133-90d0-0c4de95a9e01 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:14.188762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 131/270] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:14 2022] GET /identity/v3/role_assignments?user.id=b3d327a30f0d4bbbb1c4f154b11225d2&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:14.202599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:14.204679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:14.237822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22e92-78ac-4d87-bea7-85326531c164 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.238155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22e92-78ac-4d87-bea7-85326531c164 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.238390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a22e92-78ac-4d87-bea7-85326531c164 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.240000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 132/271] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:14.245521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.245841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.246127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.264644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:14.265909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:14.294129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:14.296031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:14.349904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 140/272] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:14.390706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 133/273] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:14.404212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.427134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.541306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09735cc6-6d68-4e47-8978-271ef36550c6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:14.582932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e694c6f-758c-4fb1-a3da-15c37824e7ae None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:14.595953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:14.596791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.597075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.597351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.599574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:14.601083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:14.603334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 141/274] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:14.611085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.642851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:14.644185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.644870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.645323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.658593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:14.662758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:14.676612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:14.684598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:14.685386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:14.687008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 134/275] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:14.687940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.710445 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:14.749373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174ded39-29df-4b96-a68f-dfeccb060444 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:14.794988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:14.796886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.797636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.798143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.799220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:14.801400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:14.808793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92699430-9823-4d56-950a-848dd1f57191 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:14.845803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:14.846656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:14.847003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:14.847356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:14.848215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:14.848609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:14.850651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:14.859665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 135/276] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:14.865247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:14.892755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 142/277] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:14 2022] POST /identity/v3/users => generated 293 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:59:14.953708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:14.984175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb549ec-d5da-4a6d-9607-5a798f6093c9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:15.023787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:15.025500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:15.026043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:15.026516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] PATH_INFO: `/v3/users/b770165d234a4b749192a60cfd54c12c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:15.043225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] RBAC: Authorizing `identity:get_user(user_id=b770165d234a4b749192a60cfd54c12c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:15.045024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4d3cd-c4f6-4ce1-8500-6c588aa7b230 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:15.048039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 136/278] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:14 2022] GET /identity/v3/users/b770165d234a4b749192a60cfd54c12c => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:15.053934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:15.157517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:15.165412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21f324-67b0-419a-b6b2-38cb562817d8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:15.203334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:15.204083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:15.204308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:15.204587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:15.205468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, user.id=b770165d234a4b749192a60cfd54c12c, scope.system=all) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:15.205823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:15.207380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2a33b-f984-43af-9ad0-064575465300 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:15.215348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 143/279] 10.222.0.65 () {56 vars in 1308 bytes} [Fri Jun 24 14:59:15 2022] GET /identity/v3/role_assignments?user.id=b770165d234a4b749192a60cfd54c12c&scope.system=all&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:15.574383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77c1e-763c-40e6-8c80-8eb4812bd6e5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:15.574564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77c1e-763c-40e6-8c80-8eb4812bd6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:15.574856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77c1e-763c-40e6-8c80-8eb4812bd6e5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:15.576498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 137/280] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:15.582355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:15.582649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:15.582976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:15.610802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:15.612023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:15.710240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 144/281] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:15.747107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e77c1e-763c-40e6-8c80-8eb4812bd6e5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:15.879065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e77c1e-763c-40e6-8c80-8eb4812bd6e5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:15.921499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:15.927641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:15.928498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:15.928782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:15.929102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:15.946020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-04a74e05-3583-4fa6-b40b-09fdf47c3ca6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:15.953963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:15.954839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:15.955632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 138/282] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:15.961521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.096526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:16.107577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6a7b7-1f1f-4a2b-8b3c-784b9d013e8a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.159726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.160413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.160705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.161004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.162358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:16.162478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5c96-2368-482c-904d-b4e9a43c5331 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.162876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:16.162948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5c96-2368-482c-904d-b4e9a43c5331 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.162948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc5c96-2368-482c-904d-b4e9a43c5331 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.164050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:16.164527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 139/283] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:16.169573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.169882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.170157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.178412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 145/284] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:16.183778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.188613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:16.189975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:16.284713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 140/285] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:16.318867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.353567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9bd6d-793b-4d61-90b5-4bf9547721f1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.426297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.427121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.427404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.427677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] PATH_INFO: `/v3/users/01af11234c034f49a4572ad7d81c8b77` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.431308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] RBAC: Authorizing `identity:get_user(user_id=01af11234c034f49a4572ad7d81c8b77)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:16.432780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:16.434674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 146/286] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:16 2022] GET /identity/v3/users/01af11234c034f49a4572ad7d81c8b77 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:16.440095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.479099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:16.524516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83c372-1958-404a-aaea-9f7b33dca5aa None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.565158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322b9bd-798b-4c12-9af3-c86da8b29650 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.587147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:16.606644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.607516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.608010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.608292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.609919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:16.611754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:16.615784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 147/287] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:16 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:16.621788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.625428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.627249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.627538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.627816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.662627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:16.677818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:16.678702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:16.679489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:16.682176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 141/288] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:16.687950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.741158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:16.759229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3b22c8-582e-46f8-b258-f0683689219c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.798326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.799243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.799528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.799804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/01af11234c034f49a4572ad7d81c8b77/roles/55c434835fc84b63845ffff7c87ef345` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.801891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, user_id=01af11234c034f49a4572ad7d81c8b77, role_id=55c434835fc84b63845ffff7c87ef345)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:16.810390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:16.839542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f5ef7-bcda-4a02-814e-5b383cc1c3ec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:16.876169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:16.876832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:16.877114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:16.877444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:16.878226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:16.878530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:16.880474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:16.889443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 142/289] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:16.894755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:16.908411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 148/290] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:16 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/users/01af11234c034f49a4572ad7d81c8b77/roles/55c434835fc84b63845ffff7c87ef345 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:16.946192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:17.023665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bb7a9b-d720-4af9-8177-13ba132e5773 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:17.076058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:17.076938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.077221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.077497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] PATH_INFO: `/v3/users/2e037839ee804d6998fe17bf7ea0952b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.082518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] RBAC: Authorizing `identity:get_user(user_id=2e037839ee804d6998fe17bf7ea0952b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:17.084619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcf844f-906a-4b36-abb4-b3ae4c863c08 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:17.086816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 143/291] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:16 2022] GET /identity/v3/users/2e037839ee804d6998fe17bf7ea0952b => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:17.092395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:17.241041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa39c5a2-f97a-4e0d-8fd4-02090074d4ec None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:17.283010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:17.283726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.284011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.284296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.312601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:17.390948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:17.392455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:17.482016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dace7f-1da0-4735-a519-a218f20ed8fe None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.482947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dace7f-1da0-4735-a519-a218f20ed8fe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.483427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dace7f-1da0-4735-a519-a218f20ed8fe None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.485128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 144/292] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:17.491213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.491783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.492283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.522856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 149/293] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:17.530753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:17.542733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:17.543944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:17.582202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:17.636878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615b76d-aa68-4ab5-b1e4-0229431475a7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:17.673957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:17.675192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.675624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.676047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.678164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:17.679757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:17.682030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 150/294] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:17 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:17.689142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 145/295] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:17.689584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:17.725337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:17.804071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:17.855507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7963b2c-ad60-4571-a82a-0c2e7039bcbd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:17.874222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:17.888555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61151f-11c7-491f-b871-e94438dc01e3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:17.893283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:17.894101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.894481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.894850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.896335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=2e037839ee804d6998fe17bf7ea0952b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:17.896739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:17.898307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e154be2-35ab-48ed-b1c7-6ad1ec889954 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:17.904844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 151/296] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:17 2022] GET /identity/v3/role_assignments?user.id=2e037839ee804d6998fe17bf7ea0952b&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:17.909497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693e47-6c37-453e-96dc-1da155d11d83 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.909905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693e47-6c37-453e-96dc-1da155d11d83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.910093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c693e47-6c37-453e-96dc-1da155d11d83 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.912518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 152/297] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:17.913880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17e05c-732e-4a0c-8378-2066db3e7b86 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.914046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17e05c-732e-4a0c-8378-2066db3e7b86 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.914283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd17e05c-732e-4a0c-8378-2066db3e7b86 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.915678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 153/298] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:17.924997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.925223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.925438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.936326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:17.938124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.938596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.939394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.943050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:17.944293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:17.954492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c2ea0dd5-a0d7-4806-9446-6a08312d15a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:17.965913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:17.967109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:17.968074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:17.971447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 146/299] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:17.974573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:17.975163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:17.975589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:17.999882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:18.002054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:18.030209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 154/300] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:18.031222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.089330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 147/301] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:18.090596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.124671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.171698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e357147-0782-4890-9ee6-e6e53ddb4cbb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.186104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.213348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.214357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.214820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.215433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.216547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:18.217036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.225445 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79857a4-137e-4e79-84dc-1902f10f790c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.225584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.236038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 155/302] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.236888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.264783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.266072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.266569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.266958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.268150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.269655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.276917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 148/303] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.277505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.348995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448756f8-a01f-4dd6-a55c-0ad6cc2cf473 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.382432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.386446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d4c46-f8a2-45de-b4d2-def51c6d1749 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.387327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.388186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.388489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.388789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.400340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:18.408309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:18.409520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:18.410506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 156/304] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:18.413587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.428514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.429484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.429788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.430061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] PATH_INFO: `/v3/users/af4fd2800803458d8112ebaf7073d80a` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.445007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] RBAC: Authorizing `identity:get_user(user_id=af4fd2800803458d8112ebaf7073d80a)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.446514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.448237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 149/305] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/users/af4fd2800803458d8112ebaf7073d80a => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.448796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.449014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.524999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0bd5ae-b695-4592-bfc2-4d0a71cc762d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.559911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38227f3-4ea2-48d8-9ac2-450972f1660e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.560415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.561038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.561324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.561600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] PATH_INFO: `/v3/groups` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.562333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.563773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.594566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.595228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.595507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.595781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.596568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:18.596870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.598317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.606411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 150/306] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.607128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.630689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.671352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 157/307] 10.222.0.65 () {60 vars in 1134 bytes} [Fri Jun 24 14:59:18 2022] POST /identity/v3/groups => generated 229 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:18.682806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:18.716280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a259-fbba-459b-9186-b716c540cb37 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.763487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.764440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.764723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.765000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.766641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, user.id=af4fd2800803458d8112ebaf7073d80a, scope.system=all) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:18.767039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.768893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.777253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 151/308] 10.222.0.65 () {56 vars in 1308 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/role_assignments?user.id=af4fd2800803458d8112ebaf7073d80a&scope.system=all&role.id=55c434835fc84b63845ffff7c87ef345 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.851034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:18.865273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00afe32-2ed0-4cc1-8f14-d146908267e7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:18.903537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:18.904499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:18.904990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:18.905272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] PATH_INFO: `/v3/users/b770165d234a4b749192a60cfd54c12c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:18.906695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] RBAC: Authorizing `identity:get_user(user_id=b770165d234a4b749192a60cfd54c12c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:18.908195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63570000-6370-4ed4-97e9-074932545d35 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:18.910401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 158/309] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:18 2022] GET /identity/v3/users/b770165d234a4b749192a60cfd54c12c => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:18.915717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:19.008893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:19.025335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec921f0-ad91-4710-8f67-1893cbc59361 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:19.064248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:19.065505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.066007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.066481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] PATH_INFO: `/v3/system/users/b770165d234a4b749192a60cfd54c12c/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.068780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b770165d234a4b749192a60cfd54c12c, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:19.070385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c1ba4-4601-4c7f-9f87-21ed33ba4098 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:19.159120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 152/310] 10.222.0.65 () {58 vars in 1334 bytes} [Fri Jun 24 14:59:18 2022] PUT /identity/v3/system/users/b770165d234a4b749192a60cfd54c12c/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:19.306965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5c933-6e00-48c1-a56a-9d164a2391fb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.307516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5c933-6e00-48c1-a56a-9d164a2391fb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.307516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5c933-6e00-48c1-a56a-9d164a2391fb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.309084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 159/311] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:19.314909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.315183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.315459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.333926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:19.335111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:19.405354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 153/312] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:19.429242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5c933-6e00-48c1-a56a-9d164a2391fb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:19.538548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d5c933-6e00-48c1-a56a-9d164a2391fb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:19.574141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:19.574935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.575216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.575491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.586226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:19.594075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:19.594931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:19.596257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 160/313] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:19.601523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:19.683516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:19.705293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36f1c-b306-4c2c-b046-37b94e426d9b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:19.741341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:19.742041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.742322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.742595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.743347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:19.743651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:19.745042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:19.754287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 154/314] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:19.762910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:19.786849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:19.870727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc67f2-8198-41f6-968b-49847fd002b0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:19.907353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:19.908300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:19.908578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:19.908845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] PATH_INFO: `/v3/users/01af11234c034f49a4572ad7d81c8b77` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:19.910217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] RBAC: Authorizing `identity:get_user(user_id=01af11234c034f49a4572ad7d81c8b77)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:19.912404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:19.914482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 161/315] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:19 2022] GET /identity/v3/users/01af11234c034f49a4572ad7d81c8b77 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:19.919980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:20.031161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b20eae-56bd-4922-af14-fea700b556ad None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:20.066393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:20.067079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.067362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.067638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.086069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:20.137673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:20.139150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:20.241526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 155/316] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:20.247061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:20.336520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:20.348910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463284-4517-49a6-8594-93290f190f9e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:20.386895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:20.388120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.388595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.389088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.390739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:20.392459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616eaa90-f352-41cb-a43f-99740d2e83b2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:20.394799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 162/317] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:20 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:20.403527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:20.448807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:20.510803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bef15e-be4e-41ba-8d7b-5db4bde3fd91 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:20.546384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:20.547046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.547329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.547604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.548446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11, user.id=01af11234c034f49a4572ad7d81c8b77) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:20.548753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:20.550230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a438e4dc-abef-4a41-90c2-96b6a7ed7de2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:20.557119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 156/318] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:20 2022] GET /identity/v3/role_assignments?user.id=01af11234c034f49a4572ad7d81c8b77&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=55c434835fc84b63845ffff7c87ef345 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:20.874379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5edf3-0ee8-4eba-ae13-2b81294d386e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.874679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5edf3-0ee8-4eba-ae13-2b81294d386e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.874948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5edf3-0ee8-4eba-ae13-2b81294d386e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.876455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 163/319] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:20.882200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d2b7d-f588-4b89-a5de-7e4b1e98b1c1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.882677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d2b7d-f588-4b89-a5de-7e4b1e98b1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.882757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d2b7d-f588-4b89-a5de-7e4b1e98b1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.899507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-198d2b7d-f588-4b89-a5de-7e4b1e98b1c1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:20.900699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-198d2b7d-f588-4b89-a5de-7e4b1e98b1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:20.968568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 157/320] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:20.991135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5edf3-0ee8-4eba-ae13-2b81294d386e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:20.996330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d5cc-1c90-4c59-9a63-3796fbc0bd8d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:20.996608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d5cc-1c90-4c59-9a63-3796fbc0bd8d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:20.996908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5d5cc-1c90-4c59-9a63-3796fbc0bd8d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:20.998612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 158/321] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:21.005937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.006223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.006674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.023946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:21.025137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:21.056592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.100936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5edf3-0ee8-4eba-ae13-2b81294d386e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.105901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 159/322] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:21.124843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.139974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.140783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.141063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.141385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.152335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:21.160105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:21.162915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:21.164585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 164/323] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:21.167831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.192020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.255249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d30b0f-19fd-4625-a4b1-4d67f74b4520 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.289338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772ebb2-caf2-45b6-8052-e1e6b9bc34f8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.292966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.293788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.294071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.294344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.295510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.297073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.302278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 160/324] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:21.305055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.328308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.329410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.329698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.330007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.330762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:21.331068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.332457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a4ad-7713-4463-bf1a-ba1ac0fb24f5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.338646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.341427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 165/325] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:21.346284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d1ff-a3e3-43b6-a908-17dbadf49519 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.346284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d1ff-a3e3-43b6-a908-17dbadf49519 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.346284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405d1ff-a3e3-43b6-a908-17dbadf49519 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.346284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 166/326] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:21.349501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d1ff-a3e3-43b6-a908-17dbadf49519 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.411383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd49240-ace0-49b5-b282-ce742441fc5b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.431161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.445888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.446555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.446833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.447181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] PATH_INFO: `/v3/groups` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.447905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.449376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.453569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405d1ff-a3e3-43b6-a908-17dbadf49519 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.486603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.487492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.487777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.488053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] PATH_INFO: `/v3/users/af4fd2800803458d8112ebaf7073d80a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.489743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] RBAC: Authorizing `identity:get_user(user_id=af4fd2800803458d8112ebaf7073d80a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.491179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8bb189-7311-4d07-8498-b72452ee419b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.492824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 167/327] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/users/af4fd2800803458d8112ebaf7073d80a => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:21.493988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.494273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.494546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.511408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:21.518843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:21.540380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 161/328] 10.222.0.65 () {60 vars in 1134 bytes} [Fri Jun 24 14:59:21 2022] POST /identity/v3/groups => generated 226 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:59:21.541233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.587788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 168/329] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:21.611391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.656217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.665816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbcc55-c967-4f66-a4d9-4c6ea2e324e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.702995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:21.706336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.707590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.708229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.708515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] PATH_INFO: `/v3/system/users/af4fd2800803458d8112ebaf7073d80a/roles/55c434835fc84b63845ffff7c87ef345` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.711390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af4fd2800803458d8112ebaf7073d80a, role_id=55c434835fc84b63845ffff7c87ef345)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.712968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.727601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8189cb48-200e-4d49-8032-0f654c91cd90 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.765675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.767047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.767557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.768032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.769543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 162/330] 10.222.0.65 () {58 vars in 1334 bytes} [Fri Jun 24 14:59:21 2022] PUT /identity/v3/system/users/af4fd2800803458d8112ebaf7073d80a/roles/55c434835fc84b63845ffff7c87ef345 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:21.780484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:21.788950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:21.789983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:21.790786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 169/331] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:21.797829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:21.923625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16303a14-9c6f-4b78-8829-e2563e45ef30 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:21.959810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:21.960477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:21.960763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:21.961039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:21.961888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:21.962231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:21.963621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:21.973999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 163/332] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:21.979342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:22.086856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6b3703-12f5-428f-bb10-38c926641c60 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:22.125003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:22.125930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:22.126213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:22.126496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] PATH_INFO: `/v3/users/b770165d234a4b749192a60cfd54c12c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:22.127717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] RBAC: Authorizing `identity:get_user(user_id=b770165d234a4b749192a60cfd54c12c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:22.129176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836f17a-2454-4bbf-bfeb-7b2a15666722 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:22.131211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 170/333] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:21 2022] GET /identity/v3/users/b770165d234a4b749192a60cfd54c12c => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:22.136596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:22.162324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:22.261362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafadb4-2c67-4ed9-9cb3-6b2855d51c16 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:22.305891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:22.306555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:22.306834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:22.307104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:22.307935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] RBAC: Adding query filter params (role.id=27f8457d6ec94bd2b715c76f7f05d279, user.id=b770165d234a4b749192a60cfd54c12c, scope.system=all) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:22.308242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:22.309697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41065055-b235-45ac-866c-9cccdcaf3439 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:22.323123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 164/334] 10.222.0.65 () {56 vars in 1308 bytes} [Fri Jun 24 14:59:22 2022] GET /identity/v3/role_assignments?user.id=b770165d234a4b749192a60cfd54c12c&scope.system=all&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:24.023874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9e2-b41e-4a55-a884-95d7da65dfdf None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.024396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9e2-b41e-4a55-a884-95d7da65dfdf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.024396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9a9e2-b41e-4a55-a884-95d7da65dfdf None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.026093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 171/335] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:24.043717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.044208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.044304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.047088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec67b-99b2-4af4-92a6-8dd8a0e05f59 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.047373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec67b-99b2-4af4-92a6-8dd8a0e05f59 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.047650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ec67b-99b2-4af4-92a6-8dd8a0e05f59 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.049011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 172/336] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:24.059234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07037f-995d-4128-936d-5b4403097921 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.059537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07037f-995d-4128-936d-5b4403097921 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.059787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e07037f-995d-4128-936d-5b4403097921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.070640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:24.079458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:24.080688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:24.087657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4e07037f-995d-4128-936d-5b4403097921 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:24.091569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4e07037f-995d-4128-936d-5b4403097921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:24.210146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 165/337] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:24.217309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 173/338] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:24.253328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:24.267808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07037f-995d-4128-936d-5b4403097921 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:24.268583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:24.436171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e07037f-995d-4128-936d-5b4403097921 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:24.465624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd541-6e22-463e-98a8-ee860b55e8fc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:24.508267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:24.509377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.514980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.515293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.520665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:24.527466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:24.528100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.532030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.532030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.539532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d256421f-d08a-43f2-ab1e-7ea9abb1f14d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:24.547262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:24.548171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:24.549367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 174/339] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:24.550621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0667ef-ae30-4ff6-84ab-ad2fcf230016 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.556711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:24.564428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:24.565305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 166/340] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:24.567677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:24.574122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0667ef-ae30-4ff6-84ab-ad2fcf230016 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.574445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0667ef-ae30-4ff6-84ab-ad2fcf230016 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.576215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 175/341] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:24 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:24.577346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0667ef-ae30-4ff6-84ab-ad2fcf230016 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:24.721253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:24.744786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0667ef-ae30-4ff6-84ab-ad2fcf230016 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:24.798549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c14cde-989c-4add-be23-7ccf27ce6f8a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:24.816966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:24.817642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.817944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.818220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.818971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:24.819277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:24.820644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c021f62-5fe3-4dd1-8f08-76d29ac80569 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:24.839897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 176/342] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:24.841251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.841488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.843014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.871553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:24.872226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:24.872812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:24.875638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:24.877030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:24.877819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:24.878666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:24.878986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:24.880643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:24.893386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 167/343] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:24.894639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:24.961393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:24.993452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 177/344] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:24.994666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.045319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe8e6f-0f99-44da-9ba7-c99914bc47a8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.102156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:25.117629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.119175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.119777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.122774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.202675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5fccc-e038-4e03-8d93-5788aed447d4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.214726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:25.216487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:25.272021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.272878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.273201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.273477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] PATH_INFO: `/v3/users/af4fd2800803458d8112ebaf7073d80a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.275809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] RBAC: Authorizing `identity:get_user(user_id=af4fd2800803458d8112ebaf7073d80a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:25.277250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:25.279771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 178/345] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/users/af4fd2800803458d8112ebaf7073d80a => generated 293 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:25.280564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.388216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:25.395865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 168/346] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:25.397158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.439801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:25.457640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a1ad3-66c9-4679-81a2-290828fedc74 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.498084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.499236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.499732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.500202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.512521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9efbd8ab-49d0-4960-b2d6-e56a1d53d949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:25.524101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:25.524997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:25.525900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:25.528271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 179/347] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:25.532125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8004c1d-9570-4043-96c3-f1f3167d3b85 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.533696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cce43-270b-46fa-855c-fb5525665d38 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.534200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cce43-270b-46fa-855c-fb5525665d38 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.534691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cce43-270b-46fa-855c-fb5525665d38 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.538175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 180/348] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:25.539315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cce43-270b-46fa-855c-fb5525665d38 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.576453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.577368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.577655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.577985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.579324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] RBAC: Adding query filter params (role.id=55c434835fc84b63845ffff7c87ef345, user.id=af4fd2800803458d8112ebaf7073d80a, scope.system=all) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:25.579820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:25.581360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:25.598756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 169/349] 10.222.0.65 () {56 vars in 1308 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/role_assignments?user.id=af4fd2800803458d8112ebaf7073d80a&scope.system=all&role.id=55c434835fc84b63845ffff7c87ef345 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:25.599690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.678317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cce43-270b-46fa-855c-fb5525665d38 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.695123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:25.762840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:25.781313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e6259-7760-46c5-882e-07b4971f9dc6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:25.790629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.791532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.791840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.792068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.798676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:25.800165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4e74-d865-4525-b55b-d3ebf448427a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:25.802989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 181/350] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:25.804335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3c12-2367-4c3f-a4e2-c38b61b08069 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.804569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3c12-2367-4c3f-a4e2-c38b61b08069 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.804843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf3c12-2367-4c3f-a4e2-c38b61b08069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.833146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:25.834127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.834549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.834927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.835791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:25.836205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:25.837921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:25.838387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a8cf3c12-2367-4c3f-a4e2-c38b61b08069 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:25.839807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a8cf3c12-2367-4c3f-a4e2-c38b61b08069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:25.853665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 170/351] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:25.854661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.934560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 182/352] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:25.936490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b8e50-ae16-4c32-b492-8bbc30f668bc None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:25.937628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b8e50-ae16-4c32-b492-8bbc30f668bc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:25.938244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b8e50-ae16-4c32-b492-8bbc30f668bc None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:25.939736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 183/353] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:25.940301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b8e50-ae16-4c32-b492-8bbc30f668bc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:25.985858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a31bfe-9774-4c85-af96-df8982371e9f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.040670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.041463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.041759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.042035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.048840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.050384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eae399-ad58-44ef-92a2-2eff89331d84 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.053434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 171/354] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:26.053434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.053661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.053927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.067061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b8e50-ae16-4c32-b492-8bbc30f668bc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.073298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:26.076778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:26.085699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.088117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.124280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.125855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.126185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.126471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.172155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 172/355] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:26.172830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.226367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.226367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.293151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21849359-af7f-42ab-a037-b5eb6cd24d6b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.335286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.336076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.336354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.336622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.348865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 184/356] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:26.352136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.352259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:26.360315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:26.361243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:26.362177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 173/357] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:26.362836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.365887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.368673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.478519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24d1ea-52f3-46d4-8842-a918373c2453 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.490519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc1d05b-75c5-40d0-b1d0-39832857217c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.527952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.528425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.528707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.528981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.529870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=b38d09dcccf44384910345b56cbf0d87) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:26.530183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.531709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edab78-6989-4e8c-829d-cf314dca2e99 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.534864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.535750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.536031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.536302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.538617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 185/358] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:26.539910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fe1d-0a1f-4349-8752-1c89cc17a328 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.540195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fe1d-0a1f-4349-8752-1c89cc17a328 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.540470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1fe1d-0a1f-4349-8752-1c89cc17a328 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.543647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 186/359] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:26.544471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fe1d-0a1f-4349-8752-1c89cc17a328 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.555664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:26.564868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:26.566141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:26.567562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:26.569921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 174/360] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:26.571691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.665069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.667620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.702846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1fe1d-0a1f-4349-8752-1c89cc17a328 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.731150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d1bd1-d955-4b37-8abd-15ffca98de25 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.750647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.751516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.751799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.752075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.753421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.755653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1703e1-1e1b-45ce-9918-19974d8ef178 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.757339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 187/361] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:26.758612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.758897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.759228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.779750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:26.780982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:26.786908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.788205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.788948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.789564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.790597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:26.791054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.794798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.810963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 175/362] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:26.812077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.880724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 188/363] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:26.881359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:26.942677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50bb5e-3a7f-4d81-9750-c7cb7d11516f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:26.971559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:26.983879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:26.984555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:26.984833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:26.985113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:26.985899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:26.986201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:26.987566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:26.991391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.000679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 176/364] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:27.000854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.031163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897463c-b9d0-4f92-92b9-47d329343f4f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.088042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.089100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.089384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.089665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.091134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.093096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.094968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 189/365] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:27.101260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.130151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41139f84-8350-4bdf-9281-2a0f4ee44c64 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.167444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.168097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.168382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.168657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.236032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8615ee-c90a-439b-a304-d9582e8122fc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.253096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.280347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.282845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.290982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.291780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.292065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.292340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.304910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:27.315893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:27.317042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 190/366] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:27.318487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.322102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.434227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 177/367] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:27.435557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.463050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e1820-3b77-4a05-9e0d-22973e054421 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.504042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.504861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.505177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.505456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.541499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.562791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6788e68-b0e3-420d-ba6d-f18bb5cd8df6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.605052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.606715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.609037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.611123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.611392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.611633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.611995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.612840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=b38d09dcccf44384910345b56cbf0d87) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:27.613155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.616652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.623706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 178/368] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:27.625665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.757996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 191/369] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:27.758890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.766248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1be67-d10c-498a-bdf7-ca18aacc63ac None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.811595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.812640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.813123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.813587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.814576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:27.815089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.817199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.827664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 179/370] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:27.828825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.860415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.875720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163a041-b357-43ad-861b-579cf6e41e30 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.877401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:27.915580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.916448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.916792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.917064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.918550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.919791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:27.921841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 192/371] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:27.922799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:27.951065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68efd2-1a74-4314-888d-00e223289ce2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:27.993119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:27.994191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:27.994480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:27.994757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:27.996515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:27.998258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.000131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 180/372] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.001489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.044506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42748bdb-c64e-47e0-9418-d02f37cc1d0f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.084910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.085557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.085949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.086130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.144304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.165081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.184592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.186641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.188817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7465e3-5e83-4f71-9df3-8ce938eaaa72 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.232276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.233341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.233834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.234244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.235575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.237139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.239798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 181/373] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.240807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.331734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 193/374] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:28.332550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.371026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d699b-ab41-48af-ba34-7739afe45529 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.423608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.425121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.426514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.426755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.427021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.430454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.432799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.437372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 182/375] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.451227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.460321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.487567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbee58a-9bf6-46c4-bae2-f9d357c20f54 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.533981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.535962 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.536759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.537242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.538531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:28.539072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.541469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.549604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 194/376] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.550824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.568048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b7761-1442-4a95-8fa1-3c824bad8148 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.636566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.637745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.638200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.638615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] PATH_INFO: `/v3/projects/7700ba2abc17485289dad312ea30cdcc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.641606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] RBAC: Authorizing `identity:get_project(project_id=7700ba2abc17485289dad312ea30cdcc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.645285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.647838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 183/377] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/projects/7700ba2abc17485289dad312ea30cdcc => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.653406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:28.744015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6399f-ad3e-4fb8-b892-fc030c7c37df None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.800482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.801530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.802841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.803312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.804300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:28.804583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.806269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891a904-2d02-4f17-9707-dc161e1aeed2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.809059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.815140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 195/378] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.817300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc3491-e5d8-4579-a624-07d064f27caa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.817586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc3491-e5d8-4579-a624-07d064f27caa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.817889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc3491-e5d8-4579-a624-07d064f27caa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.819826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:28.820865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 196/379] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:28.829054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.829567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.830125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.852120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ebcf62-bde8-47d4-9d87-a1ce7ddd0c35 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:28.874723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:28.877153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:28.945804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:28.946985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:28.947463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:28.947920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] PATH_INFO: `/v3/groups/f96abe33820f4593a09d1035548867d3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:28.958296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] RBAC: Authorizing `identity:get_group(group_id=f96abe33820f4593a09d1035548867d3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:28.960063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:28.963880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 184/380] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/groups/f96abe33820f4593a09d1035548867d3 => generated 229 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:28.970632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:29.011104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 197/381] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:29.035221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:29.107030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4926fc-f749-4e12-a640-dcf02faed46d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:29.149933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:29.151063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:29.151712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:29.152210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:29.153242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] RBAC: Adding query filter params (group.id=f96abe33820f4593a09d1035548867d3, role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=7700ba2abc17485289dad312ea30cdcc) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:29.153771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:29.155761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:29.162725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 185/382] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:28 2022] GET /identity/v3/role_assignments?group.id=f96abe33820f4593a09d1035548867d3&scope.project.id=7700ba2abc17485289dad312ea30cdcc&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:29.287812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f85275-a414-4b94-9418-e1f0d65a28db None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:29.350132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:29.359624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:29.360448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:29.367416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:29.367416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:29.373209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:29.381186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:29.382218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:29.383320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 198/383] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:29.391012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:29.436124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:29.556426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93906ae-665c-452f-a7e2-2b62d3e8c9aa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:29.597308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:29.598899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:29.599406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:29.599888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:29.600836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:29.601342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:29.602933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:29.617284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 186/384] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:29.623091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:29.775666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c0ae-3795-47aa-aab4-41c0a158fb04 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:29.821297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:29.822124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:29.822406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:29.822681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:29.823927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:29.825385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:29.831822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 199/385] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:29 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:29.839327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:29.960579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:29.997470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a4432a-0a48-4949-b814-e99d7bd9a988 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:30.048737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:30.049609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.049915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.050188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.051433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:30.052863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c3996-1c7d-41c9-9c3c-255343b184c2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:30.054909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 187/386] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:29 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:30.060699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:30.178070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:30.200461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d94-cbd9-4ed2-81f4-961cac68047b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.200754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d94-cbd9-4ed2-81f4-961cac68047b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.201113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c6d94-cbd9-4ed2-81f4-961cac68047b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.202808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 188/387] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:30.213421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.213744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.214004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.246687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:30.248145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:30.250312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d785ba3b-12ef-464d-9abf-91e98c196d43 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:30.319731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:30.320618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.320900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.321175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/groups/f72e9d69a0cc4d339f82b3696690a570/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.324547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, group_id=f72e9d69a0cc4d339f82b3696690a570, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:30.326031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:30.373843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 189/388] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:30.391885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:30.432678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 200/389] 10.222.0.65 () {58 vars in 1442 bytes} [Fri Jun 24 14:59:30 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/groups/f72e9d69a0cc4d339f82b3696690a570/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:30.482850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:30.520380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950e775-e402-4d38-9730-05f7d293c8f6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:30.572279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:30.573135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.573418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.573696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.594893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:30.603963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:30.605014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:30.605828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 190/390] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:30.611594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:30.716959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683663f-9775-42e7-b71e-a8c41cf4bb01 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:30.734933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:30.756357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:30.757036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.757317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.757596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.758373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:30.758686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:30.760058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:30.774126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 201/391] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:30.779582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:30.923632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61572fec-9ec9-4c5c-af31-e50c3cba3351 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:30.959280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:30.972288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:30.972288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:30.972288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:30.972288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:30.972699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:30.973739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea841f13-f8af-4f23-9b51-ebfddbe88b16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:30.975763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 191/392] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:30 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:30.981390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.053744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d722c1-0ed9-4bee-87df-0a0e990b2fce None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.054051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d722c1-0ed9-4bee-87df-0a0e990b2fce None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.054319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d722c1-0ed9-4bee-87df-0a0e990b2fce None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.055986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 192/393] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:31.061127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.061412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.061690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.091438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:31.092632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:31.167951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644f37b-4a79-4181-9b1d-6c0dadf1bf7e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:31.210653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 193/394] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:31.223399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:31.224579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.225082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.225547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.227075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:31.229353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:31.231388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 202/395] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:30 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:31.237437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.247832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.340883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:31.422829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a773c2a-6f87-4efb-b93e-a32645c6fb74 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:31.437571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe8ac0-fa59-411b-88ac-0541acc2f539 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:31.479510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:31.488764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:31.490705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.491783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.493497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87/groups/f72e9d69a0cc4d339f82b3696690a570/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.497278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b38d09dcccf44384910345b56cbf0d87, group_id=f72e9d69a0cc4d339f82b3696690a570, role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:31.499963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f09c-f93b-449f-840c-f6fbe78381c5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:31.502600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:31.503393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.503702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.503972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.514798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3e3ea56c-6872-48b5-9102-e70b9cc72431 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:31.522950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:31.523818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:31.525319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 203/396] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:31.526005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310bc2-574e-465f-9df1-539dcd1907d0 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.526005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310bc2-574e-465f-9df1-539dcd1907d0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.526346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b310bc2-574e-465f-9df1-539dcd1907d0 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.528827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 204/397] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:31.530415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b310bc2-574e-465f-9df1-539dcd1907d0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.581135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 194/398] 10.222.0.65 () {58 vars in 1442 bytes} [Fri Jun 24 14:59:31 2022] PUT /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87/groups/f72e9d69a0cc4d339f82b3696690a570/roles/6e961f1500a848fe9f3cc181f375ddda => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:31.587438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3549b-c0a2-4692-b28c-7e2aed1f6893 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.587952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3549b-c0a2-4692-b28c-7e2aed1f6893 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.588417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3549b-c0a2-4692-b28c-7e2aed1f6893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.622165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-68b3549b-c0a2-4692-b28c-7e2aed1f6893 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:31.623392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-68b3549b-c0a2-4692-b28c-7e2aed1f6893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:31.668248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b310bc2-574e-465f-9df1-539dcd1907d0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:31.679050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:31.700828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 195/399] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:31.702469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461c7f-71fa-4d29-bf36-56dc1f459871 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.702759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461c7f-71fa-4d29-bf36-56dc1f459871 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.703034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2461c7f-71fa-4d29-bf36-56dc1f459871 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.704423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 196/400] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:31.719278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.719587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.719839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.727618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:31.728796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.729077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.729407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.730293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:31.730593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:31.732071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:31.743189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 205/401] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:31.744148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.750219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:31.751415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:31.839594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 197/402] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:31.840179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.855164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce862d-de59-4bfa-99cf-ac6e278c0a33 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:31.893574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:31.895458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:31.895952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:31.896415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:31.905135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:31.909706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:31.920418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:31.921873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:31.922699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:31.927039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 206/403] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:31.928372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:31.962025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:31.975733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1049e7-e509-46c3-9c34-19cf86b90d02 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.015965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.017196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.018038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.018713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.021519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.023219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.025474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 198/404] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:31 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.026613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.060776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e3ecc-8dc3-4c18-9e39-5df16b422882 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.106617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.107446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.107716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.107999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.122516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:32.133597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:32.134521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 207/405] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:32.140479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.141539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471b0ae-9209-471b-8fdf-ffebf220047f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.168429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.191550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.192241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.192517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.192788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.193975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:32.194279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.196248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.209808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 199/406] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.210956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.250610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.267959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e1dde-e394-4e96-977f-36a20f0eee7a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.318318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.319760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.320040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.320313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.321828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.323947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.326572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 208/407] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.327810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.334083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e2b29f-c851-45c0-9214-86c6f4a643e7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.370313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.371392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.372130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.372631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.373572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:32.374136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.375720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.390163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 200/408] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.391504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.438819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.461253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef848-094d-4746-82a3-235b45979e3c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.507067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620064fc-6750-4ee9-bae9-068601acff53 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.510248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.511100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.511373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.511642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.514436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.516066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.523602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 209/409] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.524188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.552327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.553257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.553587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.553897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/groups/f72e9d69a0cc4d339f82b3696690a570/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.556129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, group_id=f72e9d69a0cc4d339f82b3696690a570, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.557624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.561861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.636658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b416c-f640-47ce-9838-8ce0224fed81 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.666080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 201/410] 10.222.0.65 () {58 vars in 1442 bytes} [Fri Jun 24 14:59:32 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/groups/f72e9d69a0cc4d339f82b3696690a570/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:32.667268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.696697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.700637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.701295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.701796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] PATH_INFO: `/v3/groups/f96abe33820f4593a09d1035548867d3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.705346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] RBAC: Authorizing `identity:get_group(group_id=f96abe33820f4593a09d1035548867d3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.709254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.719908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 210/411] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/groups/f96abe33820f4593a09d1035548867d3 => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.735182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.883344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.893975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd69520a-74e4-487e-af52-10083848b1d5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.895539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b5716-a08e-444b-a352-76c2d115cce5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:32.895912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:32.934273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.935146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.935424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.935695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.936861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:32.937710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.938002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.938269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] PATH_INFO: `/v3/projects/7700ba2abc17485289dad312ea30cdcc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.939425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.940850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc9dfb-b1bc-425c-a17b-6d29ff50b9af None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.942481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] RBAC: Authorizing `identity:get_project(project_id=7700ba2abc17485289dad312ea30cdcc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:32.943347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 202/412] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.944660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebace2ad-0aa7-49d1-a855-1820be8858e3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:32.944768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b924637-162a-4a28-b0eb-57fd1f8ade19 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.944947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b924637-162a-4a28-b0eb-57fd1f8ade19 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.949967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b924637-162a-4a28-b0eb-57fd1f8ade19 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.951280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 203/413] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:32.952524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b924637-162a-4a28-b0eb-57fd1f8ade19 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:32.954005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 211/414] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:32 2022] GET /identity/v3/projects/7700ba2abc17485289dad312ea30cdcc => generated 344 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:32.955488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:32.965660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:32.965660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:32.973609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:32.975075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:33.049620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 212/415] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:33.051379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:33.079845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b924637-162a-4a28-b0eb-57fd1f8ade19 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:33.118986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:33.119897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.120171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.120441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/groups/f72e9d69a0cc4d339f82b3696690a570/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.123175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] RBAC: Authorizing `identity:create_grant(project_id=5b12a807b5d641fdb59386ab6e8b0e11, group_id=f72e9d69a0cc4d339f82b3696690a570, role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:33.124612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:33.166326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:33.176224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d2854-c3eb-43db-8819-98cc8ea4ce77 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:33.193915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 204/416] 10.222.0.65 () {58 vars in 1442 bytes} [Fri Jun 24 14:59:32 2022] PUT /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11/groups/f72e9d69a0cc4d339f82b3696690a570/roles/6e961f1500a848fe9f3cc181f375ddda => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 14:59:33.195285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:33.240576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:33.241526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.241832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.242106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] PATH_INFO: `/v3/projects/7700ba2abc17485289dad312ea30cdcc/groups/f96abe33820f4593a09d1035548867d3/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.249310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] RBAC: Authorizing `identity:create_grant(project_id=7700ba2abc17485289dad312ea30cdcc, group_id=f96abe33820f4593a09d1035548867d3, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:33.252375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:33.272190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:33.322441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 213/417] 10.222.0.65 () {58 vars in 1442 bytes} [Fri Jun 24 14:59:33 2022] PUT /identity/v3/projects/7700ba2abc17485289dad312ea30cdcc/groups/f96abe33820f4593a09d1035548867d3/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:33.355841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32724cfb-2222-4e54-9f1a-9762513c6efc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:33.396886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:33.397714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.398014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.398282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.411754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:33.421588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:33.422889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:33.423746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 205/418] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:33.427094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:33.551333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0ba9d-cdcf-45fc-9699-502a8e0c4c4a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:33.591278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:33.591950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.592227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.592499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.593302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:33.593609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:33.595050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c047361-4bb6-453e-a5b7-41bd101acd4d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:33.605000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 214/419] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:33.612177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:33.734313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8543d-58a2-4e80-a5dd-887778d40409 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.734499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8543d-58a2-4e80-a5dd-887778d40409 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.734777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8543d-58a2-4e80-a5dd-887778d40409 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.736229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 215/420] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:33.745755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.745755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.745755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.767538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:33.768735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:33.776642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:33.783313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:33.790297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0aca2-760d-482b-b252-669667fdbb98 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:33.849908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:33.850568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:33.850848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:33.851123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:33.898545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 216/421] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:33.922007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:33.955543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:33.957594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:34.097227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e13434-f558-4b12-a75f-df4d68f69c2d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:34.128014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:34.143978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 206/422] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:34.151530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.166128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:34.166956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:34.167233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:34.167505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:34.188848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:34.201161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:34.202188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:34.202970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:34.214078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 217/423] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:34.219236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.232869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:34.354165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117def6d-dad4-4ab5-8389-a3fe5c3c3c27 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:34.397757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:34.398689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:34.398975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:34.399251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:34.400443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:34.401919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:34.404136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 207/424] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:34.410117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.416750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67c79e-1239-411e-ba0f-5e757f20c8f9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:34.492170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:34.492841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:34.493118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:34.493390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:34.494162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:34.494476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:34.495861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:34.514984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 218/425] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:34.521025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.521551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:34.601711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7c8a-bcd3-4f45-8c33-cecca26b116e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:34.624617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:34.656895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef7a53-a57e-450e-a8c7-99303a5c7291 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:34.693069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:34.693747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:34.694037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:34.694312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:34.702505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:34.704118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:34.704592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:34.705056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:34.710597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:34.712397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:34.714375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 208/426] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:34.723425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.773263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:34.774799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:34.841752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:34.876373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 219/427] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:34.886265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:34.999632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7c3a5-263f-46b9-ba24-4fe5fa852d0a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.040448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.041984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.042374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.042750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] PATH_INFO: `/v3/projects/b38d09dcccf44384910345b56cbf0d87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.044219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] RBAC: Authorizing `identity:get_project(project_id=b38d09dcccf44384910345b56cbf0d87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.045952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.046692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9029d47-1731-48ef-a06d-572ddc82e589 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.049401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 220/428] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/projects/b38d09dcccf44384910345b56cbf0d87 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:35.055323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.091912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:35.094630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:35.102211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.102941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.103294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.103625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.104516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=b38d09dcccf44384910345b56cbf0d87) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:35.104885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.106525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b45fe1-a96e-42b0-8752-872d8df7232a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.113315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 209/429] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:34 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 611 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:35.114530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1917aa-dcdf-4ed5-bba4-2f8d093f5c14 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.114912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1917aa-dcdf-4ed5-bba4-2f8d093f5c14 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.115251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1917aa-dcdf-4ed5-bba4-2f8d093f5c14 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.116613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 210/430] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:35.123046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.123409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.123752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.157419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:35.158590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:35.257076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 211/431] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:35.263784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299c88e2-da75-4932-a61b-ecc090651d04 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.301933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.303783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.304882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.305052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.305425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.311423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.316545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.319153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 221/432] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:35.326874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.431563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940c9f2-cae4-4f4d-9755-2da458ae854a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.456906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:35.474019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.475175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.475175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.475342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.486468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:35.490158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:35.493674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b17fa-2156-446b-b147-3941cf7aecf8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:35.495990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:35.497147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 24 14:59:35.497996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:35.501872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 212/433] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:35.503610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.546603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.547271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.549414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.549714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.551654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=b38d09dcccf44384910345b56cbf0d87) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:35.551791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.553226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29a56c9-6092-4a7c-bfad-cf3ca8ed369d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.562569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 222/434] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=b38d09dcccf44384910345b56cbf0d87&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 611 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:35.649963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076bff26-a0c6-4b05-ac73-20bb59f2df26 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.689493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.690526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.691023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.691474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.692429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] RBAC: Adding query filter params (name=member) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:35.692926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.694549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.704597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 213/435] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:35.707957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ec0e-d6b5-40f9-9ca4-0a27043869ab None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.707957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ec0e-d6b5-40f9-9ca4-0a27043869ab None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.708442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ec0e-d6b5-40f9-9ca4-0a27043869ab None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.710051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 223/436] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:35.711051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.718095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f1f6-d4dd-40cc-a563-a7b315dc54c7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.718403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f1f6-d4dd-40cc-a563-a7b315dc54c7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.718649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f1f6-d4dd-40cc-a563-a7b315dc54c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.747812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ab66f1f6-d4dd-40cc-a563-a7b315dc54c7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:35.749022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ab66f1f6-d4dd-40cc-a563-a7b315dc54c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:35.777439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:35.846288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3636b9-6838-4a86-91e3-e2e9e8c5c05a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:35.848583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 224/437] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:35.850137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eea8-7b02-461c-8a93-4736a22bb564 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.850426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eea8-7b02-461c-8a93-4736a22bb564 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.850706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429eea8-7b02-461c-8a93-4736a22bb564 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.852207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 225/438] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:35.857626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.857832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.858106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.878565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:35.880072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:35.889903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:35.890801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:35.891085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:35.891358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:35.969930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 226/439] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:35.972124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:35.985835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:35.987460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:35.999671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.036761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.086975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c1be-09b2-43b7-9258-ee6ac975e369 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.093496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 214/440] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:36.094377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.125912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.126728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.127057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.127343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.138079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:36.146766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:36.147695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:36.148478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 227/441] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:36.149112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.199484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a5752-ae90-46ec-94e9-119c9dd8b168 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.234780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.235052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.235789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.236024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.236296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.246111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:36.250947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd887978-fa66-47e3-8bc6-a2163fb32faa None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:36.254364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:36.263830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 215/442] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:36.265465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.266309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.296072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.296974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.297255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.297534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.298787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.300279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.302088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 228/443] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:36.302855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.369123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a208e67-7113-46d1-ba02-2937aac1d127 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.403343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.404038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.404257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.404537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.404746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b499e-28e3-4f99-84b0-a715b9654372 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.405285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:36.405592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.407065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.416251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 216/444] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:36.417222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.439562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.440241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.440521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.440825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.442156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:36.442462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.443830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.452254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 229/445] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:36.453063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.470428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.480249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.517424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1129c5cc-0558-416e-8e3d-dbe244513cc0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.551844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.552705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.552994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.553269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.554475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.554839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a698a-79d3-46ae-a462-d6eaa05ed0b6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.555901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.557691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 217/446] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:36.558397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.589475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.590341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.590628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.590908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.658010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.659132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3700c7-f5df-4755-8ffd-031ef225699d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.659486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.673713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.687940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.693289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.693964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.694241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.694512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.759151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 230/447] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:36.760705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.761999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.763691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.860192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025364d8-dc27-4904-97bc-2da22d80227b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:36.865503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 218/448] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:36.865503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.878787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.892161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:36.899699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:36.900783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:36.901409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:36.901758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:36.903234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=27f8457d6ec94bd2b715c76f7f05d279, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:36.903794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:36.906695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:36.918255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 231/449] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=27f8457d6ec94bd2b715c76f7f05d279 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:36.919305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:36.974743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de159dab-112a-4d2a-9a80-7855800774cf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.012857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.013700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.014034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.014331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] PATH_INFO: `/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.015579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] RBAC: Authorizing `identity:get_project(project_id=5b12a807b5d641fdb59386ab6e8b0e11)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.017042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.018815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 219/450] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/projects/5b12a807b5d641fdb59386ab6e8b0e11 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:37.024404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:37.052019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5cf20-6123-4cdd-82ea-c8434c74e77d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.091971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.092840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.093446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.093446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] PATH_INFO: `/v3/projects/7700ba2abc17485289dad312ea30cdcc` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.094731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] RBAC: Authorizing `identity:get_project(project_id=7700ba2abc17485289dad312ea30cdcc)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.096184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.099104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 232/451] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 14:59:36 2022] GET /identity/v3/projects/7700ba2abc17485289dad312ea30cdcc => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:37.105392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:37.140899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:37.145267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e06bc-27f2-4106-adb3-4bea38936c28 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.166158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:37.182240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.183100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.183384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.183660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] PATH_INFO: `/v3/groups/f72e9d69a0cc4d339f82b3696690a570` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.184918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] RBAC: Authorizing `identity:get_group(group_id=f72e9d69a0cc4d339f82b3696690a570)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.186744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.189303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 220/452] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:37 2022] GET /identity/v3/groups/f72e9d69a0cc4d339f82b3696690a570 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:37.198018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:37.235317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8634ff9-b26e-49aa-99e7-d6ccaa934b00 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.274999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.275774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.276053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.276322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] PATH_INFO: `/v3/groups/f96abe33820f4593a09d1035548867d3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.277504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] RBAC: Authorizing `identity:get_group(group_id=f96abe33820f4593a09d1035548867d3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.278974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.280910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 233/453] 10.222.0.65 () {56 vars in 1180 bytes} [Fri Jun 24 14:59:37 2022] GET /identity/v3/groups/f96abe33820f4593a09d1035548867d3 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:37.287017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:37.327478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa791c8-3770-4313-b779-145d5bff3c3e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.361399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.362065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.362343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.363148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.363967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] RBAC: Adding query filter params (group.id=f72e9d69a0cc4d339f82b3696690a570, role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:37.364270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.365682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c7d141-9640-4608-8662-811392e3f778 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.371457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 221/454] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:37 2022] GET /identity/v3/role_assignments?group.id=f72e9d69a0cc4d339f82b3696690a570&scope.project.id=5b12a807b5d641fdb59386ab6e8b0e11&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:37.389065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9487-51f9-4b06-ab72-8a3eafa28419 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:37.404913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:37.427455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:37.428134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:37.428412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:37.428692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:37.429640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] RBAC: Adding query filter params (group.id=f96abe33820f4593a09d1035548867d3, role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=7700ba2abc17485289dad312ea30cdcc) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:37.429891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:37.431348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcda09-78a4-455a-af29-5ab4b68283d7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:37.438127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 234/455] 10.222.0.65 () {56 vars in 1376 bytes} [Fri Jun 24 14:59:37 2022] GET /identity/v3/role_assignments?group.id=f96abe33820f4593a09d1035548867d3&scope.project.id=7700ba2abc17485289dad312ea30cdcc&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:40.215938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca041f-53be-4aa8-b2be-1e8efbeb4919 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.216781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca041f-53be-4aa8-b2be-1e8efbeb4919 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.217227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca041f-53be-4aa8-b2be-1e8efbeb4919 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.218785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 222/456] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:40.224406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648950c-0613-4068-b12c-638aa524301c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.224895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648950c-0613-4068-b12c-638aa524301c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.224986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648950c-0613-4068-b12c-638aa524301c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.239703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dc0a5-6fd9-4a3a-a45a-40852c78d48a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.240026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dc0a5-6fd9-4a3a-a45a-40852c78d48a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.240249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5dc0a5-6fd9-4a3a-a45a-40852c78d48a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.241798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 223/457] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:40.247319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.247900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.248375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.250370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5648950c-0613-4068-b12c-638aa524301c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:40.251947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5648950c-0613-4068-b12c-638aa524301c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:40.286739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:40.288274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:40.337262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:40.366582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 235/458] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:40.379078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539698-1a01-4629-9b61-11c9f94ddd3c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.379379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539698-1a01-4629-9b61-11c9f94ddd3c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.379630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50539698-1a01-4629-9b61-11c9f94ddd3c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.385575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 236/459] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:40.387114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.387401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.387676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.412390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:40.412955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 224/460] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:40.413714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:40.414342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.511809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 237/461] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:40.512406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.527631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d6512-7c26-4059-af01-7a0c3bf150c9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.555416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:40.568002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:40.569173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.569669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.570171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.581175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:40.582927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:40.603342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:40.604229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:40.605070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:40.605070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:40.605070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.605070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:40.607381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 225/462] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:40.613611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.618659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c7120-8a99-4bd1-9c8c-42cecce41d73 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.631706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:40.653319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:40.654043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.654327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.654605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.666044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:40.667680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:40.686800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:40.687706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:40.688548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:40.688548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:40.688548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.688548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:40.688548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 238/463] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:40.688822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.732546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55992b06-45a9-4891-99f8-5c4a86f23c45 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.771182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:40.771891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.772609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.772889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.785089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:40.786720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:40.788593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:40.797735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb22c3-c489-42be-a272-e18c52371f10 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-bd6bd547-0e83-45e9-acbf-a77aebc144d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:40.805812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:40.806858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:40.807790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:40.807790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:40.807790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:40.807790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:40.807790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 226/464] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:40.808375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ea06-0c8a-4024-be74-9038b48acca1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.808594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ea06-0c8a-4024-be74-9038b48acca1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.808946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89ea06-0c8a-4024-be74-9038b48acca1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.810376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 227/465] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:40.811090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89ea06-0c8a-4024-be74-9038b48acca1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.841961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:40.842884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.842884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.843154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.843882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:40.844190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:40.845571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:40.863246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 239/466] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:40.863246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:40.888115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:40.927798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89ea06-0c8a-4024-be74-9038b48acca1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.970533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:40.971189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.971469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.971768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:40.972491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:40.972797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:40.974226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21050194-2135-40f3-94fb-52367cd46426 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:40.974911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a608-9324-4380-bb68-ad1b46c6b943 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:40.996728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 228/467] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:40.996728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:40.996728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:40.996728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.011158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:41.012337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:41.016582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.017265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.017542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.017859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.018801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:41.019114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.021002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.035220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 240/468] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:41.035806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.048479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.088548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 229/469] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:41.098853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.148183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae2489-006e-4a7e-959b-bce9c47f0b25 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.163757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.186801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.187710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.187991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.188261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.188994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.191113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.211466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d89cf01-3c6f-4456-b173-728ae40a7400 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.250119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.250780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.251057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.251331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.252077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.254104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.299426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 241/470] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/users => generated 246 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:41.300180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.376134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 230/471] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:41.382145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.396601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.437529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987cdcb-d655-484a-a404-66c2460d5859 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.491150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.491854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.492168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.492422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.493143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.495234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc1a94-e169-4dcf-bfe4-6ce9fc067bd8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.534537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975fa023-a800-4ff3-b9ae-6ce5cbbc7a16 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.550075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.574454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.575247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.575527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.575799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.585422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 242/472] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:41.587768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006c96-f040-4a50-b6c1-0a65707f1350 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.587768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006c96-f040-4a50-b6c1-0a65707f1350 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.587768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006c96-f040-4a50-b6c1-0a65707f1350 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.588954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 243/473] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:41.593836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.594835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.595116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.595387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.595478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:41.614675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:41.615622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:41.616542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:41.616542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:41.616542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:41.616542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:41.616759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:41.616839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 231/474] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:41.617392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:41.624395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.737123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 244/475] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:41.771580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.775620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1487961-b21a-4c21-8529-47f2337be49f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.819933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.820523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.820806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.821137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.821973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:41.822286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.824175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.837176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.844101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 232/476] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:41.849492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:41.886595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:41.893563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d233f-405a-4136-95dc-2859389a4dc5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.934042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:41.934716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:41.934995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:41.935266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:41.936045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:41.937428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:41.977164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.sql.core [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:59:41.977164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 14:59:41.977164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [parameters: {'id': 'e2d61da80af743cfb082e66c2da98a61', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 14:59:41.977164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80513) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 14:59:41.984862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6522b7bf-17ca-4cc0-a896-3360dd6e7782 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result.read() Jun 24 14:59:41.999139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return ref.to_dict() Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:59:42.000059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application yield resource Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application next(self.gen) Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise self.value Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application session.commit() Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 14:59:42.001520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.session.flush() Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application compat.raise_( Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 14:59:42.002641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 14:59:42.004108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application conn.query(q) Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result.read() Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 14:59:42.004901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [parameters: {'id': 'e2d61da80af743cfb082e66c2da98a61', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:42.005692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 24 14:59:42.008629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.010895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 245/477] 10.222.0.65 () {60 vars in 1131 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/roles => generated 144 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:42.010895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:42.040580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:42.041654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:42.042478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:42.042982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:42.044220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:42.046727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:42.148350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c15c9-8169-461f-a7c3-44bff0ea0c20 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:42.166811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:42.179448 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 233/478] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:41 2022] POST /identity/v3/users => generated 249 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 14:59:42.203054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:42.203959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:42.204247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:42.204525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:42.234691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-1f86f2da-46a2-4f20-9344-2da3fa25bf08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:42.243219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:42.244184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 24 14:59:42.244973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:42.251297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 246/479] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 14:59:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:42.258424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:42.401017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:42.426021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff56f3d-d5b5-4678-bf16-2f3ec44882b0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:42.559130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:42.559806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:42.560089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:42.560367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:42.561131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:42.561440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:42.562848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2143b40-003c-4ec7-892c-1945f22486f3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:42.575994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 234/480] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:43.659520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a4a8-4fa4-412a-a74e-594ccc6d2a97 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:43.660041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a4a8-4fa4-412a-a74e-594ccc6d2a97 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:43.660041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50a4a8-4fa4-412a-a74e-594ccc6d2a97 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:43.661672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 247/481] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:43.678417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:43.678897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:43.678972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:43.707308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:43.708515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:43.811137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 235/482] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:43.855437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a4a8-4fa4-412a-a74e-594ccc6d2a97 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.007643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50a4a8-4fa4-412a-a74e-594ccc6d2a97 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.059431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.060247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.060533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.060810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.077056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-dff40636-84b2-487e-a7c7-4443bb25d116 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:44.087120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:44.088286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:44.089064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 248/483] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:44.095171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.181262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2458-adbb-47a7-be74-0f56baea8552 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.181582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2458-adbb-47a7-be74-0f56baea8552 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.181868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e2458-adbb-47a7-be74-0f56baea8552 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.183507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 249/484] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:44.199310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366639-7c2d-4d95-81af-d302ae38581f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.199608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366639-7c2d-4d95-81af-d302ae38581f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.199873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df366639-7c2d-4d95-81af-d302ae38581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.206913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.239640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-df366639-7c2d-4d95-81af-d302ae38581f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:44.240930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-df366639-7c2d-4d95-81af-d302ae38581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:44.257153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa31e7-9577-43a2-be29-6a18b3573540 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.301460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.320544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.321228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.321508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.321806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.322578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:44.322884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:44.324266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:44.340230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 236/485] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:44.346131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.362187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 250/486] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:44.375596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d4a5-3ffc-4831-b40c-388af4b12fe7 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.375902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d4a5-3ffc-4831-b40c-388af4b12fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.376184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7d4a5-3ffc-4831-b40c-388af4b12fe7 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.377849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 251/487] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 14:59:44.383144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.383448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.383701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.404310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:44.405558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:44.490665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee2313e-4bea-489c-8d3a-61eedf2737a4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.493792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 252/488] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:44.494869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.549046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.550852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.551356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.551880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.554745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.567878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:44.570381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:44.593972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:44.594848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:44.595675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:44.595675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:44.595675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:44.595675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:44.598694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 237/489] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:44.599858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.618309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.626474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016fc6f-7b53-4e60-ac4d-f84b7602467f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.670401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.671294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.671575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.671848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.682595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:44.690147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:44.691067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:44.691882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 253/490] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:44.692540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.729339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801563c2-ed3c-4277-974a-3a220fd7e872 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.763405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.764201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.764480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.764757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.776570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c06bde1b-01d4-4d46-b2aa-4849d813cf46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:44.785114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:44.786053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:44.786865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:44.791040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 238/491] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:44.792623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9192de-e4d1-4e55-a16a-1519f700b95c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.792727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9192de-e4d1-4e55-a16a-1519f700b95c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.793009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9192de-e4d1-4e55-a16a-1519f700b95c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.797849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 239/492] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:44.797849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9192de-e4d1-4e55-a16a-1519f700b95c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.798326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aca89-20e9-43b8-9f18-e876c73c59b9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.833770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.834358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.834633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.834917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.835634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:44.835938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:44.837295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:44.854098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 254/493] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:44.854098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:44.855516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.871479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:44.915706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9192de-e4d1-4e55-a16a-1519f700b95c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.951847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:44.952520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.952790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.953064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.953831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:44.954244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:44.955490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80397f5-2a90-4ee5-8f71-f29ebd915ed1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:44.957233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd478fe9-3fb5-452f-8903-fcb2e1f51fff None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:44.963653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 240/494] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:44.964878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:44.965162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:44.965439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:44.982583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:44.983813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:45.009270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.010999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.011698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.012177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.013320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:45.013701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.015275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.029437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 255/495] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:45.029437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.069886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 241/496] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:45.074104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.114726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.116729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.138123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5526261-6a29-4280-b38c-30aa2983f140 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.173085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.173913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.174197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.174475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.177178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237b93-c183-4b4c-afad-b095afcf1a78 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.182829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.184271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:45.199732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:45.200666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:45.201541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 256/497] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:45.202624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.223665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.223665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.224207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.224492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.239305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.240917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:45.261628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:45.262748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 242/498] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:45.263761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.326259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606c4662-aa39-4dbe-a67e-252dbb870fe5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.362018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.364620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.365486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.365746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.366034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.371820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbf00a7-1aca-4718-a21b-843cd37b3189 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.378039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.378039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.378915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:45.400555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:45.407592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 257/499] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:45.408772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.409785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.409785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.409785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.410609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.421602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:45.429502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:45.430405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:45.431190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 243/500] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:45.431852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.507106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe7b67-6a46-4a70-a834-d475eb5c3590 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.536815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9c898-a535-444e-8d40-e28aa963fcb6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.541225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.541999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.542206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.542487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.543325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:45.543630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.545070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce5198e-f622-4023-94ec-79d1b07daff4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.570103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.570748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.571026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.571296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.572008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:45.572310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.573669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 258/501] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165317-090b-4fc2-88b7-cde605f45bdc None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165317-090b-4fc2-88b7-cde605f45bdc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f165317-090b-4fc2-88b7-cde605f45bdc None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 259/502] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:45.585931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f165317-090b-4fc2-88b7-cde605f45bdc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.589766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 244/503] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:45.589907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.602126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.637838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.687878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ed1c3-fea9-4b8a-b5d1-85d35613b949 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.689304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f165317-090b-4fc2-88b7-cde605f45bdc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.721510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.722696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.722975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.723249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.723486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.723988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:45.724152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.724292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.724416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.724696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.725416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:45.725654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.725753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.727123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bbc02-9a83-47eb-9511-3347d850726f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.736307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 245/504] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:45.737752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.741556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 260/505] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:45.742900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.743191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.743471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.764069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:45.765287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:45.823153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.834845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 261/506] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:45.835736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:45.853034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716bc5a-54a1-4ee8-8c40-b41d6afc935e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.877604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:45.888123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.888705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.888981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.889249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.936571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f41a5-17b3-40c4-8bd0-76bac7dca2ad None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:45.955937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.957382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.969138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:45.969974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:45.970271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:45.970534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:45.978135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:45.979563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:45.994368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:45.995277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:45.996432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 262/507] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:45.996988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.031644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.073617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 246/508] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:46.074475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.099463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.103358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b63ee-0e6f-40b2-932c-1c3ff56251c5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.139269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.139970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.140244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.140513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.151160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.152612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:46.170802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:46.171670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:46.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:46.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:46.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:46.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 263/509] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:46.172785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.183220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac47f-48e9-4cd9-b48b-3d8a9cb00c78 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.216930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.218092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.218092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.218307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.226193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.227649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:46.243354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:46.244241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:46.245166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 247/510] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:46.246295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.277091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.282880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b6786-48ac-427a-a31a-133a3b54a945 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.318007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.318815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.319132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.319438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.331258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.332762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.348407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965341-08cb-4fcd-89bc-2decc97ecff8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:46.351889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:46.352741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:46.353598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:46.353598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:46.353598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.353598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:46.353598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 264/511] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:46.353901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.356667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.384120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.384786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.385061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.385332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.386211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:46.386509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.387940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.425383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 248/512] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:46.426169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.499786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6403d-58c9-469b-a733-a7a806a0b00a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.532858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.533754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.534621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.534895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.544817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.546289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.556696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:46.564110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:46.570895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:46.571732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:46.571732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:46.571732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:46.571732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:46.571732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 265/513] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:46.571997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128765f4-5c13-4c6a-823f-6fd7c1971496 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.572078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.600529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.601188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.601468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.601765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.602486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:46.602795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.604177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.615205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 249/514] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:46.615999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.622669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.666631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45e679-ca61-475a-a5eb-2b880076ecd7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.702679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.703292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.703534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.703805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.704627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:46.704929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.706912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.715619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e9c706-812e-4a07-9220-d0f4122315af None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.724728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 266/515] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:46.725553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.748274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.748955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.749225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.749495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.750242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:46.750543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.751913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.764285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 250/516] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:46.765112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.777434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.825574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f56130-8558-466e-898f-749b7d7aadc0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.839655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:46.860015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.860661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.860941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.861216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.863222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0f112-4bd9-4026-bac0-a5a1f07d65e0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:46.897350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:46.898032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:46.898317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:46.898594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:46.899312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:46.899622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.901011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.912046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 251/517] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:46.912844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:46.932194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:46.933644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:46.980758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.015489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b564892-f07c-4792-818f-2049393e7e37 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.040647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 267/518] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:47.041499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.050551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.051345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.051626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.051900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.056277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.059637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.061117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:47.075876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:47.076999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 252/519] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:47.078440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.156604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa840b-0dae-47e9-98a1-71581b988ddd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.190836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.191478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.191755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.192027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.192170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f504d7-dbc6-4ebc-9843-e5ad4f63b562 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.220756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.226747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.227420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.227702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.227979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.228686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.230154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.263837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.265246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.278796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.315631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 253/520] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 14:59:47 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 14:59:47.316478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.381624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 268/521] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:47.382569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.439507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25e22-cbf1-4c51-831a-865adeedf6ec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.479474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.480271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.480561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.480821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.491044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.492529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.509831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda0bbfc-a9d0-441f-a5e2-4ecafd95be87 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:47.510114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:47.511050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:47.511888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 254/522] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:47.512358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.532456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.555460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.556356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.556528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.557106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.567845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.569284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.570636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:47.587009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:47.589076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:47.590034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:47.590034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:47.590034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:47.590034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:47.590034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 269/523] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:47.590818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.626614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400057e9-c74e-4cf1-9636-a2f78b5cba2c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.663654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.664898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.665191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.665468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.666617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:47.666927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.669548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.691720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 255/524] 10.222.0.65 () {56 vars in 1139 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:47.693348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.702597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ef12b-c91b-45f4-9211-85f5d92d5940 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.743807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.744768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.745388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.745702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.759623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.761318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:47.784979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:47.786132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:47.787075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:47.787075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:47.787075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:47.787075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:47.787819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 270/525] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:47.788666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.800323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2da4-7583-449d-93f1-ad13243ef9f4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.803475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.807458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:47.841877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.842549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.842839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.843118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.843912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:47.844222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.845655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.865657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 256/526] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:47.866541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.898151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e8bef-0c34-479d-a422-503de7518bcc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:47.937264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:47.937955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:47.938265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:47.938549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:47.939203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:47.939504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:47.941545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:47.955970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 271/527] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:47.955970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:47.986450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f99ead-a0bc-4207-b5e8-3d3013faec46 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.023421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.024072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.024356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.024632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.035225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.057709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.058218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f35de-b72d-4a80-8bbd-f07074a32344 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.093125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.093873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.094183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.094425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.095142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.095444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.096850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.098110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.099574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.109191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 272/528] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.110451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.217155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 257/529] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:48.217155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.221641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4068f79-cd49-4055-8aba-bdcd3eb505c2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.260669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33976d1-8300-497b-b817-056454a32adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.261327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33976d1-8300-497b-b817-056454a32adb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.261611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33976d1-8300-497b-b817-056454a32adb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.261949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33976d1-8300-497b-b817-056454a32adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.262746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33976d1-8300-497b-b817-056454a32adb None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.263054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33976d1-8300-497b-b817-056454a32adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.264495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33976d1-8300-497b-b817-056454a32adb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.267479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.274150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 273/530] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.274150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33976d1-8300-497b-b817-056454a32adb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.298907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.349977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c352c-3bdf-4694-86b5-f14182d292b9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.387039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.387860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.388141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.388419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.396672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.398197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.403454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33976d1-8300-497b-b817-056454a32adb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:48.415151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:48.416207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:48.417217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 258/531] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:48.421829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.443715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.444574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.445331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.445331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.453875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.455005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:48.472239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:48.473320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:48.474245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:48.477857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 274/532] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:48.478752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.546460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.548692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50d894-e3d6-4a52-8a1a-22a90a806b99 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.574851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.586810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.587512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.587792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.588065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.595230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515dd953-f273-4691-8e4e-fb7fb19c35ed None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.599037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.600503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:48.620286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:48.621556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:48.622495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:48.622495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:48.622495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:48.622495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:48.622495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 259/533] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:48.622927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.635891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.636905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.637325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.637754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.638730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.639213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.641186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.661938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 275/534] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.662995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.732888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4faa1f-58d9-43b0-97f2-3692169cdbfc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.771324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.772203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.772583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.772974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.773512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d356b-190a-4738-b6c0-99af2200abdd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.773988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.774353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.776045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.789615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 260/535] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.790886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.797710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.814190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.814919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.815155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.815430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.816151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.816452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.818003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.833887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 276/536] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.833887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:48.851434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:48.928638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf418e9d-8f33-4c89-8e9f-fe43dfb6e2e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.963471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:48.964279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:48.964389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:48.964659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:48.965505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=53da70e1f5bf46ec924902edf423ca91) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:48.965838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:48.967271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:48.968072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c524fa-8f21-4751-8bbe-77a5ce157bd6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:48.980137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 261/537] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/role_assignments?user.id=53da70e1f5bf46ec924902edf423ca91&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:48.980137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:49.042093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:49.042847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.043126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.043401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.044303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=d167f6076c5745169fede7f865e056da) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:49.044611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:49.046133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:49.064420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 277/538] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/role_assignments?user.id=d167f6076c5745169fede7f865e056da&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:49.140682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:49.145049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed804a8-9008-48c4-b993-e4221a76b40d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:49.192048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:49.192874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.193153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.193426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.210643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:49.212114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:49.238379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:49.239308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:49.240144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 262/539] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:49.247136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:49.311371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:49.374714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76104ae1-3226-4ef9-9130-72e3c68ed1c2 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:49.419058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:49.419642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.419920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.420190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.420973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:49.421276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:49.422728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eee929-6335-440e-8a97-b4d4d1ea3159 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:49.440273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 278/540] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:49.446542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:49.481219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733ee5-141a-4906-b8ab-f03d0cce22f9 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.481541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733ee5-141a-4906-b8ab-f03d0cce22f9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.481790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0733ee5-141a-4906-b8ab-f03d0cce22f9 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.484752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 279/541] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:49.489879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.490169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.490433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.517049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:49.518868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:49.629237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f4a7f-34f7-4d91-b7df-5558e9a030c0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:49.649837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 280/542] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:49.693196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:49.702200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:49.702873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.703163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.705323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.706241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=8131b0b0725f461a97be0423b7d8bb16) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:49.706558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:49.708003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:49.719386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 263/543] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:49 2022] GET /identity/v3/role_assignments?user.id=8131b0b0725f461a97be0423b7d8bb16&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:49.738078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:49.820115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253259f-c75d-426c-be15-9c80d0ae20bf None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:49.864671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:49.865502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:49.865811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:49.866089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:49.887004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:49.896069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:49.897026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:49.897850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:49.901879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 281/544] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:49.903878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:49.960175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:50.046220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7d87b-7b5b-4d52-9e9f-fc18ecaced1e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:50.081059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:50.081741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.082043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.082321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.083062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:50.083366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:50.084741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:50.093570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 264/545] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:50.099407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:50.244614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:50.252369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdfa8b-272a-4ec9-9ce8-8063395af35f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:50.295508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:50.296625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.297079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.297524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.318784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:50.320496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:50.340843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:50.341695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:50.342641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:50.342641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:50.342641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:50.342641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:50.344219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 282/546] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:50.350001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:50.462595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:50.478654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a504be-8c69-4378-a4f0-8777d8017d53 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:50.513330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:50.514031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.514321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.514591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.515324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:50.515632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:50.517028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb83d35-1854-4810-89f5-f7771eba7cb2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:50.530951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 265/547] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:50.539402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:50.646528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697839-8f80-42bc-84fa-557d5053a6f6 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.646814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697839-8f80-42bc-84fa-557d5053a6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.647093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db697839-8f80-42bc-84fa-557d5053a6f6 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.648742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 266/548] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:50.653931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.654214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.654488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.677027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:50.678264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:50.717587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46eb6f-cd04-4c62-afec-44c099152fdb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:50.748597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 267/549] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:50.785749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:50.789336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:50.790169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:50.790454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:50.790732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:50.806509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:50.807944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:50.829460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:50.830846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:59:50.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:50.841774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 283/550] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:50.844824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:50.862433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:50.930093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:50.965883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459e27f-ae75-4aef-b184-b5c3b28a9a03 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.020231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17afd30-f3cf-4a58-a886-d40bef9925f7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.030411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.031214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.031511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.031750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.060986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:51.072477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:51.073436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:51.074310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:51.080588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 268/551] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:51.084304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.084996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.085279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.085556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.086438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:51.086748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.088198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.091409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.127639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 284/552] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 14:59:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:51.128971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.236335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59546375-0e26-4809-ab9a-1b27956fa2f2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.262128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.286060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.286660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.286945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.287226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.287986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:51.288296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.289680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.296500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.305241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c4cc5-7791-48fe-b842-6dd086a40f12 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.312243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 269/553] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:51.318664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.362466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.363133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.363414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.363691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.443200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cf48-8f81-4d1e-b91e-f4be403c2a57 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.512992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.514655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e75d-0afd-4407-bcc5-b36c5870f324 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.520697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.521557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.521896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.522182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.541964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.543346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:51.577590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:51.578596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:51.579631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:51.579631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:51.579631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:51.579631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:51.579631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 270/554] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:51.586762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.649576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.666300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.694678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 285/555] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 24 14:59:51.694678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af79fe-610a-4cb8-a036-f85027f98b78 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.694678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af79fe-610a-4cb8-a036-f85027f98b78 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.694678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af79fe-610a-4cb8-a036-f85027f98b78 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.698720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 286/556] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:51.699648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af79fe-610a-4cb8-a036-f85027f98b78 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.716961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2bd8a-6f41-4d5f-85d8-e53e27fc3ad9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.753475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.754199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.754480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.754755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.755480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:51.755783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.757156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f4181-0abc-4b57-81c5-f4892e695a5f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.769993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 271/557] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:51.771348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.771633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.771908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.789296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:51.790674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:51.819888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af79fe-610a-4cb8-a036-f85027f98b78 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:51.857393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:51.858525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.858808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.859084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.861392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 272/558] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:51.867272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.871472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:51.873834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e6068575-7b5f-4ab6-8772-809e0ac0f746 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:51.893909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:51.895332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:51.896204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:51.896204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:51.896204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:51.896204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:51.896204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 287/559] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:51.896480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b251-483d-4307-985f-150f3eef024e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:51.897476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b251-483d-4307-985f-150f3eef024e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:51.897476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a7b251-483d-4307-985f-150f3eef024e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:51.898322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 288/560] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:51.901996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7b251-483d-4307-985f-150f3eef024e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:51.919157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.924740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:51.997943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a061a-706b-4266-859e-22677b9f2a5c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.005165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a7b251-483d-4307-985f-150f3eef024e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.039162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.039952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.040231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.040506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.041294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.042101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.042540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.042820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.050833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:52.051830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.053265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:52.058470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.059582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:52.060427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:52.065194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 289/561] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.065943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2bc6a4be-0834-48dd-805d-b5d2bc28d0f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:52.071719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.072669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:52.073688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:52.077592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 273/562] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 14:59:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.078949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.079237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.079513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.097031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:52.098268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:52.148634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.171235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 274/563] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:52.171987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.178343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685c6a57-7bf8-44a4-9c2e-7a7f95ecafda None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.206643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.216452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.222017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.232831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 290/564] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:52.233660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.275539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427451b-077e-48ea-b17a-33bf4f27d62f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.308520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.309180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.309460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.309756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.310561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.310862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.312235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49eb601-505c-4eba-8392-72a247a47959 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.320900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 275/565] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:52.322230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8849dc-cd50-4f0d-bfbe-59a6b91b8aae None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.322453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8849dc-cd50-4f0d-bfbe-59a6b91b8aae None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.322730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8849dc-cd50-4f0d-bfbe-59a6b91b8aae None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.324139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 276/566] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:52.324638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8849dc-cd50-4f0d-bfbe-59a6b91b8aae None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.335116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff56be-d3d3-454a-8712-2256bf91f1a5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.369299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.369992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.370275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.370798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.371664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.371968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.373392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.375914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.390773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 291/567] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:52.391611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.427996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.440616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8849dc-cd50-4f0d-bfbe-59a6b91b8aae None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.476957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.477771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.478415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.478701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.489193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:52.497133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.505178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 277/568] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.506243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.507100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07530f0-10a0-4cd9-ba8e-86ac0c10abdb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.540477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.541264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.541539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.541839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.548560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.550022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3d7bcd64-480f-418d-9abe-99924660729f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:52.563438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.564498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 292/569] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.571015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.571665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.583950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:52.585068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:52.609262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7899cc-0ef3-4d1b-91d7-5a5521eaf794 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.640383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.645167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.646015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.646297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.646574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.658762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.660231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.660943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 293/570] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:52.661922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:52.678472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.679497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.680438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:52.680438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:52.680438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:52.680438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:52.680438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 278/571] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.681294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.685350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.779643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1348f3f-c7bb-43e7-ae28-9861c164a03c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.786495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69752179-5758-4754-a198-dfa7dd47b958 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.814412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.815704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.816159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.816436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.822902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.823571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.823855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.824133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.824892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.825201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.826732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.829340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.831512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.836127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 279/572] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:52.837004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:52.849497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:52.850662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 294/573] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:52.851932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:52.887282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.915480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:52.955381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbedfd-a7f7-4cce-94af-0b74d1315b8d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.956145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0579fb9-b545-4640-b42d-d3df8c97626c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:52.994011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.994659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.994936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.995206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.996243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.996545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:52.997105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:52.997792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:52.997983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:52.998411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:52.998411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:52.999048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:52.999356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.000708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.012927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 295/574] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.017917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.018126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 280/575] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.018126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.120940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.126944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bcd098-ee0a-4dd6-9c72-76aaf4f1dcca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.131507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4429bef-72eb-4e4b-b794-cae700b92aaf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.159860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.162221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.163024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.163305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.163574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.169732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.170964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.170964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.172133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.175686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:53.182476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:53.183681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:53.184769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:53.185827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:53.186602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.186692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 296/576] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:53.186692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:53.206417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:53.207634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:53.208737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:53.208737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:53.208737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:53.208737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:53.212311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 281/577] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:53.212959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.302985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baddd5e-d3d4-417e-aa19-2cf3ff4e33eb None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.316868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44dda2-ffd5-478d-bfbd-c6aacc794d36 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.342883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.343556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.343834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.344116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.344840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:53.345146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.347216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.352506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.353770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.354260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.354601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.361254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 297/578] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.362767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.363152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.364609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:53.381179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:53.383553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 282/579] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:53.384700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.390141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.428188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.493707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e71eca-4485-4859-8d88-46e6a256383d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.493977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34a574-8492-4b6a-9cf7-befb5abe3040 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.527953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.528654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.528885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.529158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.529370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.529932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:53.530053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.530237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.530328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.530595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.531420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=bd11123cb5a64281b8c0336ee2a56f0d) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:53.531624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.531721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.533118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.539136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 298/580] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/role_assignments?user.id=bd11123cb5a64281b8c0336ee2a56f0d&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.539928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.544609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 283/581] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.544609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.644635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.663033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.665080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b25f0-f337-4d76-9ed7-525b1792187a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.665927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd9dee-0eaf-453b-b3ac-e12e60e9ad98 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.703594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.704409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.704647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.704782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.704944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.705522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.705847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.706121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.706841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:53.707152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.708519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.712495 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.713941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.720823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 299/582] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.725705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:53.728022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:53.728954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:53.729858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:53.735094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 284/583] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:53.736154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.838928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca083c-581b-4e9c-9e62-1eb43aa4a31d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.840508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08105c8-d271-49ef-a228-675adc3c5cd7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:53.874649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.875309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.875590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.875774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:53.875903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.876588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:53.876689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:53.876871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:53.876975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.877820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:53.878967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.890217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:53.891400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:53.891834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:53.901834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 300/584] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:53.902850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:53.916023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:53.916957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 285/585] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:53.918418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:53.934623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.019124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc7580-d5bc-48d3-b269-929d44929ac0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.025179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb204c-2a79-4cc1-ad40-d373a63d6292 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.054895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.055699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.055981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.056262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.061456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.062354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.062810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.063253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.063596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.064413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:54.065422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.065588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.067470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:54.080079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:54.081637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 14:59:54.087498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:54.088066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 286/586] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:54.088066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.088193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 301/587] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:54.088193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.150139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.177319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.191164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2704c759-5956-4e8a-a3d5-d1dcc3d02b71 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.193460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50050c15-9303-4f9b-aebe-44ba642c6a6d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.229768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.230439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.230718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.230987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.231714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:54.232020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.233393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.236817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.237860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.238313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.238752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.245763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 302/588] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:54.246559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.255228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.256901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:54.275532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:54.276658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:54.277876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:54.277876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:54.277876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:54.277876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:54.278551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 287/589] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:54.279349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.358159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a0092-88ec-4be9-985a-a95b29a77e9b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.376277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.382987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6e142-da39-4a37-b6f8-f3e51b858059 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.394296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.394966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.395248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.395525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.396416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:54.396664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.398125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.410228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.416898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 303/590] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:54.421399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.422059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.422357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.422640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.422953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.439203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=ecc895f2eaa245dc8f1b5d811a4c88e0, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.441447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.524656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab53ea8-039e-484d-b323-ff5a72c92cd6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.532678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 288/591] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:54 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:54.533786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.581314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.582186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.582523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.582804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.592750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.594470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:54.617138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:54.618208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 14:59:54.619150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:54.623495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 304/592] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:54.624472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.672760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.675508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df9014-6576-46ed-afa5-289fa75741fe None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.724304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.724506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.724769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.725049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.725825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:54.726135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.727526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.741118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 289/593] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:54.742034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.760562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327b743-b5c0-4531-8ad0-0e36c0f407ca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.790533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.804364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.805322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.805670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.806043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.819245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.821493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:54.845063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:54.846601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:54.847657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:54.847657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:54.847657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:54.847657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:54.847657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 305/594] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:54.848724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.886062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e3901-2707-4d68-a4c8-3035279c20b1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:54.932775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:54.934122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:54.934622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:54.935322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:54.937268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:54.937806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:54.940275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:54.958121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:54.965556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 290/595] 10.222.0.65 () {56 vars in 1139 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:54.966648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:54.974011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0620a8c-6d59-4765-be59-5c09ecccfca1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.024257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.025026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.025308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.025581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.038214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.039688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:55.053587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:55.054542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.055447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:55.059510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 306/596] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:55.060386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.088301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.099131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5af2-e951-43dd-9ca7-56eea43c486f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.150145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.151191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.151809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.152270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.153993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:55.154477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.156008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.171572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 291/597] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:55.173118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.190564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978dc50-4096-4c7d-b2b9-0b83a59c4d70 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.226246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.227197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.227573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.227982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.240390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.242015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.251118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:55.263136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:55.264221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:55.265669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:55.265669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:55.265669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:55.265669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:55.265669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 307/598] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:55.266828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.305257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0d5dc-847b-484c-8f16-79c4b47f260b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.343533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.344512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.345004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.345455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.346499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:55.347025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.348670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.362754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 292/599] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:55.363896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.380401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.385963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88706583-18d8-4cd2-bc4d-d4788d4b74de None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.422427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.423239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.423519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.424358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.432257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.433813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:55.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:55.450939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 308/600] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:55.452443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.478695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2045246-ec68-45ae-8a8c-8b2bbc979b90 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.516167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.517198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.517902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.518529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.518696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.519819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:55.520084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.521559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.534447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 293/601] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:55.535357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.567586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a618ae9-9ba6-4c8b-9556-80948138057b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.605949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.607304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.607725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.608139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/d167f6076c5745169fede7f865e056da/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.610855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.626123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=d167f6076c5745169fede7f865e056da, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.627862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f186f-2989-446c-b8e9-e23f644d9699 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.642808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afdc4b-68be-49e1-b318-83d9d79dae83 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.680065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.680763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.681050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.681322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.682136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:55.682439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.683866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.697419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 294/602] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:55.698311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.740257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 309/603] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:55 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/d167f6076c5745169fede7f865e056da/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:55.741614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add856-3e3d-4421-adb5-bfa876d7c32c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.741930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add856-3e3d-4421-adb5-bfa876d7c32c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.742210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94add856-3e3d-4421-adb5-bfa876d7c32c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.747973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 310/604] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:55.747973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add856-3e3d-4421-adb5-bfa876d7c32c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:55.821577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5d20b-cab1-4097-8811-b51af1252701 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.863760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.869243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.870637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.871180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.871631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.881189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.881845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94add856-3e3d-4421-adb5-bfa876d7c32c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:55.882962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:55.896094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0cc3f917-5f03-495f-aec5-2d4c0ad4195e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:55.899929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:55.900829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:55.901791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:55.906390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 295/605] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:55.907918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.909188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.914205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.927990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:55.929235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:55.935035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:55.936224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:55.936701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:55.942891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/53da70e1f5bf46ec924902edf423ca91/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:55.958672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=53da70e1f5bf46ec924902edf423ca91, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:55.960707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.005908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 296/606] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:56.009850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.053455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 311/607] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:55 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/53da70e1f5bf46ec924902edf423ca91/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:56.054559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.143653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe433670-d854-4e2b-8dff-a724e92d8898 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.171042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:56.182376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.183049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.188663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.188663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.188663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:56.188663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:56.188663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.201749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 297/608] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:56.214815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.253002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f489e566-892b-4745-b3ba-bc1325349399 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.293065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.294175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.294606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.295037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.307303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:56.316233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:56.317471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:56.318478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:56.325894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 312/609] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:56.327474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.353218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:56.367220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dad510-83b7-4f72-96cd-72f02ce15472 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.404322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.405152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.405488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.405796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/8131b0b0725f461a97be0423b7d8bb16/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.423125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=8131b0b0725f461a97be0423b7d8bb16, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:56.424738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.447980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8b349-6fc5-44c7-9419-89f6afc33351 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.488501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.489171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.489454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.489743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.490596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:56.490906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:56.492270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.501472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 313/610] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:56.508167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.560508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 298/611] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:56 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/8131b0b0725f461a97be0423b7d8bb16/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:56.609631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:56.631471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8307b2-53ad-4b02-ad6d-f46f91d1a0c5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.669436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.670284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.670616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.670901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.684482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:56.686161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-30dd6dee-ad67-41d8-8191-9e197ff4d0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:56.706091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:56.707050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:56.707942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:56.707942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:56.707942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:56.707942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:56.712359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 314/612] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:56.713837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.730508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ab7-55b5-42c8-a791-462835288d16 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.730825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ab7-55b5-42c8-a791-462835288d16 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.731057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd7ab7-55b5-42c8-a791-462835288d16 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.732704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 315/613] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:56.738678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.738956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.739228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.761149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:56.765007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:56.766357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:56.853924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 316/614] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 14:59:56.879572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12712b8-ce86-4d03-b966-bfdf7d8150dd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:56.887713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:56.923031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:56.924288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:56.924816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:56.925101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:56.925866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:56.926177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:56.928280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:56.943729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 299/615] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:56.948949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.003750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.061091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.071594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c3137b-65f6-4373-822e-70365168bc35 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.114222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.115563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.116005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.116290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.125331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.127262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:57.128845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7433a8-5ced-400d-bdf8-974862baec0c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:57.144422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:57.147024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:57.149219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 300/616] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:57.157745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.269104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb9c4e-bf46-4872-a3d7-4830652fd1ef None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.278438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.279258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.279539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.279816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.293531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:57.309105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.309105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:57.309524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:57.311548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:57.313598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:57.315365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.315365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.315365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:57.315775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 317/617] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:57.315917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.315917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:57.321743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.332778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 301/618] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:57.343364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.369489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.518996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9f4f2-2547-454c-833e-4e7f2755c93d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.520136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571155b5-fe60-4457-bfba-0419a777bff4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.544356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.556254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.557185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.557611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.558188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.559153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:57.559634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.561159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:57.570412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 318/619] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 14:59:57.576565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.622555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.623388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.623673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.623955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.646902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.648477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:57.681186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:57.682409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:57.683476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:57.683476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:57.683476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:57.683476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:57.690781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 302/620] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:57.696758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d40371-27bb-473b-bb7c-af854c8d6657 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.698343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.736428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.737473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.739412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.740684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.763636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.766086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:57.800659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:57.801781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:57.802806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:57.802806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:57.802806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:57.802806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:57.806484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 319/621] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:57.812574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:57.829918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.891728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:57.900909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab6dbe9-c09b-4388-9773-27a646943f0f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:57.973834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:57.974500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:57.974838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:57.975120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:57.975849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:57.976159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:57.977545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.000908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 303/622] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:58.005165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5291425-d2e6-44de-bc88-1cbe3e8b4edd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.007766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.072764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.073355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.073637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.073982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.074767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:58.075347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.076742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.109053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 320/623] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:58.110429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.201024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99560b-4661-4598-9f10-8748e550bc61 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.232008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.244304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.245421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.254860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.254860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.254860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.255288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.271228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-298eef6b-18ca-4516-80ad-0c7e65a79c86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:58.275178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:58.276295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:58.277417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:58.278008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405547d3-3bfc-43f7-b9c2-23966ff7a01d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.283010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 304/624] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:58.283010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cce0-643d-4af2-96f3-426536a08180 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.283010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cce0-643d-4af2-96f3-426536a08180 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.283010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56cce0-643d-4af2-96f3-426536a08180 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.288182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 305/625] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:58.289009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56cce0-643d-4af2-96f3-426536a08180 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.323355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.324063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.324342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.325411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.333350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.334881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-10cde1e7-24f4-42ef-8973-a6270dd13dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 14:59:58.349860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:58.350881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:58.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 321/626] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 14:59:58.353509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853602-de4a-4735-80a6-326838d5c622 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.353963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853602-de4a-4735-80a6-326838d5c622 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.354245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03853602-de4a-4735-80a6-326838d5c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.376077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-03853602-de4a-4735-80a6-326838d5c622 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:58.378197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-03853602-de4a-4735-80a6-326838d5c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:58.426340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56cce0-643d-4af2-96f3-426536a08180 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.462028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 322/627] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:58.463198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03853602-de4a-4735-80a6-326838d5c622 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.479190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.480196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.480735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.481185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.485068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:58.485397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.487439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.506052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 306/628] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:58.507085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.562151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.575328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.588246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03853602-de4a-4735-80a6-326838d5c622 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.628876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.630161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.630649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.631181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.632042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197668-694d-4a3d-a13e-7b82763fb561 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.632441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:58.632963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.634868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.654486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 323/629] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:58.655740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.670719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.671520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.671803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.672079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.683037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5d73e39b-6c69-433a-94e3-bf130e1d49aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:58.690713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:58.691665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:58.692520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 307/630] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:58.693207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4545b-2d5d-4dfa-9c89-94932c8f771c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.693816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4545b-2d5d-4dfa-9c89-94932c8f771c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.693816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4545b-2d5d-4dfa-9c89-94932c8f771c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.697848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 308/631] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:58.697848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4545b-2d5d-4dfa-9c89-94932c8f771c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.776764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0915d7-42f1-47e7-851b-20f543d7cd30 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.806160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4545b-2d5d-4dfa-9c89-94932c8f771c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:58.807969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.811383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.812273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.812548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.812820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/bd11123cb5a64281b8c0336ee2a56f0d/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.827386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=bd11123cb5a64281b8c0336ee2a56f0d, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.828743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:58.831755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:58.844738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:58.845901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:58.850013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:58.850013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:58.903948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 324/632] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 14:59:58 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/bd11123cb5a64281b8c0336ee2a56f0d/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 14:59:58.905016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:58.927508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:58.929227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475d4a6-0ca9-4bbe-9da5-9c306229b0c5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.048979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35c28-6010-47de-8379-77e096dd5c7a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.050371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 309/633] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 14:59:59.051956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939b7d-8cc0-4439-91a0-3f03781f2108 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.052343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939b7d-8cc0-4439-91a0-3f03781f2108 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.052715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc939b7d-8cc0-4439-91a0-3f03781f2108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.059636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.074700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fc939b7d-8cc0-4439-91a0-3f03781f2108 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:59.075914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fc939b7d-8cc0-4439-91a0-3f03781f2108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:59.091770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.092448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.092734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.093017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.093788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:59.094099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.096020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.105212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 325/634] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:59.106153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.151547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 310/635] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:59.153170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db70a3-c675-4ecf-aef1-a05e9e6e5191 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.153451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db70a3-c675-4ecf-aef1-a05e9e6e5191 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.153740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db70a3-c675-4ecf-aef1-a05e9e6e5191 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.157786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 311/636] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 14:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 14:59:59.157786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db70a3-c675-4ecf-aef1-a05e9e6e5191 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.175586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.226457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f1800-c555-4537-b3bf-92a86f09a059 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.263047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.263879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.264168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.264447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.276657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.278155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.282274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db70a3-c675-4ecf-aef1-a05e9e6e5191 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-af22ec85-dcad-47eb-8e4d-6060094dda57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:59.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:59.299232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:59.300156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:59.300156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:59.300156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:59.300156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:59.300156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 326/637] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:59.300998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.301286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.301566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.319672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 14:59:59.320872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 14:59:59.325102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.331129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.332161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.332647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.333077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.344524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.346316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 14:59:59.365435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:59.366527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:59.367405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 14:59:59.367405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 14:59:59.367405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 14:59:59.367405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:59.371587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 312/638] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:59.372418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.413007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 327/639] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 14:59:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 14:59:59.414332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.462447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.494920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8b4f-122b-4320-bece-3e168c642c73 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.524066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34690bd9-e983-4211-8920-679fae2cc198 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.529768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.530562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.530837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.531106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.541308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:59.549024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:59.550197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:59.551020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 14:59:59.555106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 313/640] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:59.555776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.563574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.564787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.565179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.565462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.566225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:59.566534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.568040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.582022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 328/641] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:59.582941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.608656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.665738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09038-8ea2-4298-b74a-e136e3166da8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.692095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.695561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881663a-7969-4e60-b0d3-89d234ec52c3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.702244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.702918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.703197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.703475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.704199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:59.704502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.705906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.718921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 314/642] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:59.719909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.741138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.742477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.743145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.744015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.756571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 14:59:59.765553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:59.766764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:59.767757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 329/643] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:59.770568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.836290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036176c6-e46c-4347-bfab-1e3482974d28 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.838948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 14:59:59.873050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.873764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.874112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.874856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.875896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 14:59:59.878121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.879689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.887614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c79f7a-0f8d-4600-b208-185b397ccfa3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 14:59:59.893078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 315/644] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 14:59:59.893078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.928933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 14:59:59.929740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 14:59:59.930023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 14:59:59.930297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 14:59:59.939870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 14:59:59.941332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 14:59:59.960778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 14:59:59.961799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 330/645] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 14:59:59.967820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 14:59:59.989074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.007252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301aced-a5fb-4092-b5b0-5cddcd7f35c3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.044662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.045525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.045829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.046101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.055478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.057007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:00.073194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:00.075373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 15:00:00.076317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:00.080231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 316/646] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:00.081174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.093330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee1833a-7d83-4daa-a262-6b826696f1a5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.113546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.145513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.145513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.145513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.145513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.145954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.145954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.145954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.146707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 331/647] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 14:59:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.147628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.194606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8001a4-fdc9-40b7-9386-a6acbcc4d89d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.231865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.241508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.245669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.245669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.245669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.252417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750cd7-b7bf-44ec-bda3-def1f6dbeb10 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.254380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.256358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:00.274667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:00.275591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:00.276494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:00.276494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:00.276494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:00.276494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:00.276494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 317/648] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:00.277200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.293129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.293843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.294111 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.294385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.295174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.295482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.296899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.314839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 332/649] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.314839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.364140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.389591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db5d22-a121-4af0-894f-87f45ea97c76 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.428567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.429152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.429443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.429800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.430575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.430881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.432305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.434835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cc88f-206d-47f6-8e7f-c85ac5923536 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.451575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 318/650] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.452699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.476726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.477525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.477829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.478108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.488979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.490452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.492412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:00.510916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:00.511867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:00.512752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:00.512752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:00.512752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:00.512752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:00.512752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 333/651] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:00.513030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.568056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bddaa-ab3d-4de2-994b-b17b1150f340 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.605453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.606159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.606433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.606710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.607426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.607725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.609093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.612246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.616891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e81c-fdc1-487c-8234-20c6d862fee8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.621849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 319/652] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.622760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.657199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.658219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.658489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.658775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.659589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.659900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.661345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.667441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 334/653] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.668252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.747376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.768991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fe746-79e6-4d6b-aa55-9b363759d9fe None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.805769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d1e59-f346-4df6-a48e-330519cbab64 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:00.811647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.812296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.812572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.812843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.856243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:00.856914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:00.857196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:00.857600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:00.858393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:00.858692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.860074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:00.875559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 335/654] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:00.880047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:00.903196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:00.911575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:00.913080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.002802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398140bb-4162-406f-bbf9-97cf08ed3ced None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.021588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.036113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 320/655] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:01.037564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.040062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.040861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.041436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.041915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.050729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.052350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7596b1f3-2046-4139-99ac-0275c6f8d26e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:01.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:01.069120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:01.070086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 336/656] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:01.071265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16322-30e3-447f-87a1-466881b305fd None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.071265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16322-30e3-447f-87a1-466881b305fd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.071265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc16322-30e3-447f-87a1-466881b305fd None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.076562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 337/657] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:01.076562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16322-30e3-447f-87a1-466881b305fd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.152826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.160979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae26790b-3455-4a7f-9767-17d1dcb88ed5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.181012 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc16322-30e3-447f-87a1-466881b305fd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.196636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.197634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.198111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.198608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.208710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.210444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.220249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.226591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.226591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.226591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:01.232111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:01.233328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 321/658] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:01.237174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.247405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.248888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-48c61777-6adf-4ee7-b132-ba20a1bb648b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:01.272175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:01.273105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:01.274423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:01.274423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:01.274423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:01.274423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:01.275044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 338/659] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:01.276339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.276624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.276904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.296128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:01.297325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:01.325667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.366157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb3806-98c4-4a16-96a7-c7c2a368111d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.380277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 339/660] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 15:00:01.381056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.409861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.410852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.411374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.411657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.412511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:01.412822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.414294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.439797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 322/661] 10.222.0.65 () {56 vars in 1137 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:01.439797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.454849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.498481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b034-d7aa-4ef2-a615-5e3f4ba6c9cb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.534986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.535533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.535790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.536068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.536902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:01.537202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.538658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.547655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408101f-9a65-445e-b041-119aca0fa7a5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.561617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 340/662] 10.222.0.65 () {56 vars in 1139 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:01.561617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.581055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.590021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.590687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.590972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.591246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.591969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:01.592276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.593739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.609858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 323/663] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:01.609858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.671428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824024ef-2f00-4c82-9045-124e0b6d2ad8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.692119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.709471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.710452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.711050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.711334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.716467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ff517-925c-44a0-b0cf-947fb650b2da None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.724022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:01.731712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:01.732793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 341/664] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:01.734636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:01.760590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.761261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.761544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.761855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.819311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.839903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.840081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027156c-55c5-465b-9084-3d647fb4bd22 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:01.841648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.876835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:01.877478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:01.877871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:01.878150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:01.920347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:01.950689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:01.952534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:01.954110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 324/665] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:01.955720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.033517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.060802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 342/666] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:02.060802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.065531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8bea2-38b1-4e9a-a476-d753b391408c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.102667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.103459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.103743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.104021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.111314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.112744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:02.126945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:02.127843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:02.128735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:02.132811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 325/667] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:02.133640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.170089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed87bf-2486-40ef-a1b8-ac0abafc9b69 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.170476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.208085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.209428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.209956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.210471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.211257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.211563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.213284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.226548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 343/668] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.227458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.246917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc14c50-eb34-4457-beb7-a609e0edadf7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.268269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.285822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.286666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.286944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.287228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.298442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.299887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:02.318561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:02.319530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:02.320417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:02.320417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:02.320417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.320417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:02.320417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 326/669] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:02.320713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.331952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba0c79-743e-4e94-b025-bc0fc285601b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.368158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.368876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.369157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.369433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.381906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.383356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:02.400750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:02.418447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 344/670] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:02.419359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.433391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.449424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3f1b-7d71-4ad1-a3df-6263e9dce42a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.487763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.488425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.488703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.488973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.489779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.490097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.491530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.506245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 327/671] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.507084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.509577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.518709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acff83-f164-403c-89c4-a462a77af33d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.553835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.554640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.554920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.555198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.566258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.567753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:02.585117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:02.586336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:02.587415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:02.587415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:02.587415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:02.587415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:02.590894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 345/672] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:02.591626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.622812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984087ca-5141-42c6-8639-b4d2e2a8782e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.666098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.667039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.667468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.667924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.668785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.669286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.670842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.682839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 328/673] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.683880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.693368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.706937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701932c-d54f-4f12-a092-e284f85a06db None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.743866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.744532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.744813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.745463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.746227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.746539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.747927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.761136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 346/674] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.761835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.772723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.809608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0975131c-624f-46af-9c4c-f7ad04ddf556 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.846903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.847556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.847839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.848118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.848952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=d167f6076c5745169fede7f865e056da) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.849266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.850735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.856984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 329/675] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/role_assignments?user.id=d167f6076c5745169fede7f865e056da&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.857822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.896019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c6b93-d003-4e0f-9b83-7af743bffb15 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:02.933080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:02.933855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:02.934147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:02.934419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:02.935155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:02.935455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:02.936877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:02.939484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:02.950569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 347/676] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:02.951714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:02.981093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc69922-7585-4d94-8d47-dd3094169d67 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.020801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.024353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.026209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.026209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.026209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.034010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.036272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-92cffd1b-032b-4d6c-9e86-829e2917880f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:03.053624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:03.054675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 330/677] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:03.056732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f425-c8f8-4407-8fc0-be6e99c1deae None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.057290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f425-c8f8-4407-8fc0-be6e99c1deae None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.057290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64f425-c8f8-4407-8fc0-be6e99c1deae None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.059393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 331/678] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:03.059393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64f425-c8f8-4407-8fc0-be6e99c1deae None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.073189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6047-0ff7-4fcd-8528-bc469b2e171f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.125594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.127597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.127946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.128231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.138807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.140616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:03.161094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:03.162034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:03.162925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:03.168446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 348/679] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:03.168446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.180921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64f425-c8f8-4407-8fc0-be6e99c1deae None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.217824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.228841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.228841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.229310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.229583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.240068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.243318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e2b2b769-e32c-46a1-b9b1-cb0a8103d7ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:03.270608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:03.271653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:03.272588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:03.278186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 332/680] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:03.279536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.279821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.280098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.298968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a730a-00f6-42e4-8952-3e9be7b7e3b0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.302631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:03.303201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:03.329240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.343279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.348947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.364061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 349/681] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:03.365492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.397513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 333/682] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 15:00:03.398513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.511730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5295b4-648e-4f0b-9f2c-8317c1d55e03 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.512337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a19ef-61f3-4890-ba60-291853e9246c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.532845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.550406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.551095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.551433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.551629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.552472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:03.552775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.554263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.566292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.567116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.567508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.567787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.568814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:03.569537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.570890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.577431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 334/683] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:03.578381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.585178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 350/684] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:03.586130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.651528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.700645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceccd12-429d-462b-906b-f1a11c18411b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.723744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe830df-647c-4c29-aefe-9377200f7920 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.736822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.737463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.737763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.738038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.738853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=53da70e1f5bf46ec924902edf423ca91) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:03.739161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:03.740574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:03.753746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 335/685] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/role_assignments?user.id=53da70e1f5bf46ec924902edf423ca91&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:03.753746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.772848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.773674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.774061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.774409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.790422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:03.801631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:03.802395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:03.803374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 351/686] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:03.815288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:03.876348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fa45e-f0d9-435e-b920-56951fbcb775 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.920187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:03.920424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:03.920782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:03.920975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:03.966968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90238d-765a-420d-a1a6-dd799c3f5c38 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:03.969268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:03.998547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.001403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.004958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.005622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.005941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.006217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.007050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=8131b0b0725f461a97be0423b7d8bb16) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:04.007360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.008798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.021814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 352/687] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/role_assignments?user.id=8131b0b0725f461a97be0423b7d8bb16&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:04.021814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.059352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.134240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 336/688] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:04.143530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.170854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccfe2c-a362-409f-aad7-d05e09f58a7c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.218650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.219348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.219627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.219899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.223684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:04.223684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.223684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.243305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 353/689] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:04.248946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.290532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.310953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5095a21-ee7d-42cb-bf90-7f9547e2a9ef None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.355544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.356335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.356623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.356898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.374109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.376360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.377684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e035c0-36cf-4089-a746-e129bb5cd4a5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.378276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:04.400903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:04.402933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:04.404469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:04.404469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:04.404469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:04.404469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:04.404469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 337/690] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:04.411401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.422077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.422965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.427271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.427271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.435837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.437291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:04.456106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:04.464112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 354/691] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:04.466630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.551647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6952b09-c38a-4b72-8790-8253e0cd4416 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.571621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.592186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc667253-36cf-49ed-9a15-9bc9ed72525c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.632007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.632673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.632954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.633228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.634006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:04.634310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.636359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.650622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 355/692] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:04.655350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.656041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.656320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.656595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.657325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:04.657672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.660220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.663202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.688065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 338/693] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:04.694073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.772174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0be50-4f1a-412b-8d02-aabdbcdc5548 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.808429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.809529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.810016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.810585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.817039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.819939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.821676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:04.838101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:04.856788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 356/694] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:04.857754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:04.918102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516fe3a-d75c-4585-a7ff-426d88a44691 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.977471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9596802-2e88-47cc-bc41-9aabc1dca8f6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:04.979796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:04.982104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:04.982623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:04.983159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:04.994124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:04.996398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-54897129-9dc3-48ca-9219-e95ca55dd2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:05.014477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:05.015627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:05.016727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:05.018997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 339/695] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:05.020511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a95c5-0b6e-4a55-9e41-b031ae03ce4e None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.020974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a95c5-0b6e-4a55-9e41-b031ae03ce4e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.021390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a95c5-0b6e-4a55-9e41-b031ae03ce4e None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.023199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 340/696] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:05.025550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a95c5-0b6e-4a55-9e41-b031ae03ce4e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.039202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.040158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.040617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.041065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.042230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.042789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.044389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835838-0d96-4630-beef-7aae18b79b1a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.066582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 357/697] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:05.072694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.073604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.074114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.091932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:05.093388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:05.145537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a95c5-0b6e-4a55-9e41-b031ae03ce4e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.157556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.160995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.172640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 358/698] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 15:00:05.174664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.190324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.191100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.191272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.191543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.192333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.192996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.194105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.207989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 341/699] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:05.209859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.310235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aae2a-a6b7-4dd6-8cb5-d28984cecbcc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.331034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b58f70-bfab-4acd-be79-5a794eb45f5d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.347496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.348492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.349106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.349573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.369212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.370481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.370695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.370978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.371671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.373162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:05.388748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:05.389882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:05.390847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 342/700] 10.222.0.65 () {56 vars in 1129 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:05.391801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.423343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.435934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.437622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.440185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.503166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013be07b-45c0-45eb-8b5f-0aa724b4a00f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.540986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.541646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.542157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.542376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.543216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=bd11123cb5a64281b8c0336ee2a56f0d) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.543570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.545114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.553807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 343/701] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/role_assignments?user.id=bd11123cb5a64281b8c0336ee2a56f0d&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:05.553807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.554941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 359/702] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:05.556191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.661183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.673694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063d29a-479d-44d9-9cca-e91ccda93054 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.692230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6691473-6cc0-423f-b575-9e17b5fe6cc4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.694103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.715305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.716444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.716912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.717557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.729428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.731234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:05.754202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:05.755174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:05.756050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:05.756050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:05.756050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:05.756050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:05.756309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.756309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.756309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.756309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.756876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.757181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.758568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 360/703] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:05.763139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.764482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.766296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 344/704] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:05.775723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.871210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6047a-a238-4357-b38c-22d1cc03e05b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.888819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a0daf-b32b-4fde-a9bb-880bd0b3607c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:05.907153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.908178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.908681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.909155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.910115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.910628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.912264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.925570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 361/705] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:05.930641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:05.931204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:05.931930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:05.932209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:05.932483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:05.933249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:05.933557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:05.934848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:05.935817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:05.943027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 345/706] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:06.050898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0596c8f6-3429-417f-8853-e444f95ed9cd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:06.089609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:06.090963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.091449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.091949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.100743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:06.102641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-66959bd2-e88c-412d-aa7b-681efdca72af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:06.118992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:06.120228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:06.121101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:06.123029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 362/707] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:06.129608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:06.171491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:06.248109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992883ef-9317-4924-8418-574de32f5bf2 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.248475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992883ef-9317-4924-8418-574de32f5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.248830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992883ef-9317-4924-8418-574de32f5bf2 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.252695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 363/708] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:06.256322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.256884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.257359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.274283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ab22d-6449-4775-869f-75a40857756e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:06.281138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:06.284696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:06.360067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:06.361303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.361582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.361883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.362677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:06.362983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:06.364421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:06.383327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:06.398301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 346/709] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:06.400219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 364/710] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 15:00:06.409211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:06.431170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:06.561557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:06.580047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76abdd-ae20-4e4f-8da5-d4f82028882c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:06.647850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35217f-edbe-4e7b-a794-bd96059fead6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:06.663803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:06.664902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.666013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.666607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.668882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:06.669456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:06.671212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:06.678661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 347/711] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:06 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:06.727321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:06.728407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.728866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.729293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.750334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:06.752093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b3ec7275-5cb2-48b0-b263-62035a21ba50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:06.781278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:06.783086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:06.784242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:06.784242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:06.784242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:06.784242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:06.785931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 365/712] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:06.792036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:06.908265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201eb-6828-444d-a877-0084159047e6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.908612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201eb-6828-444d-a877-0084159047e6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.908820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516201eb-6828-444d-a877-0084159047e6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.910236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 366/713] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:06.919412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:06.919693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:06.919972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:06.943680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:06.944893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:06.949133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce751349-24fc-46ba-b624-958035ef60b8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:07.008447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:07.009035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:07.009318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:07.009597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:07.010348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:07.010657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:07.012032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:07.027851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:07.039405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 348/714] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:07.043625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:07.068195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:07.080429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 367/715] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 15:00:07.106988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:07.216406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91715215-086d-4139-839d-be0ec3825a4a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:07.247999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876727b5-1ca3-41de-b3f7-a08249a211b6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:07.285375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:07.286452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:07.286942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:07.287422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:07.288332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:07.292299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:07.315322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:07.316507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:07.317039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:07.317523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] PATH_INFO: `/v3/services/network` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:07.318445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:07.320080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:07.334947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:07.336031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:07.336905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:07.340039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 368/716] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:07 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:07.346435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:07.391778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:07.400413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 349/717] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:00:07 2022] POST /identity/v3/users => generated 254 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:07.472293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b7a5c-7f27-4ec5-9528-ffdd36798fba None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:07.527435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:07.528525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:07.529010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:07.529487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:07.530450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] RBAC: Adding query filter params (name=network) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:07.530963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:07.533104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28628073-2d2b-4cf5-9c29-1ef8fc42d99f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:07.541958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 369/718] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:07.547922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:07.631204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:07.663740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ba92-4a26-4edb-8db9-9bae2b5b3d5f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:07.699883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:07.700552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:07.700834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:07.701110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:07.701841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:07.702150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:07.703507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded12213-0a37-4f82-8f0e-aaa35e76b7c8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:07.708508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 350/719] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:08.414559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847397-a80e-40fd-b86b-7da489d9d75e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.414941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847397-a80e-40fd-b86b-7da489d9d75e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.415121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847397-a80e-40fd-b86b-7da489d9d75e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.416795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 370/720] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:08.422508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.422798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.423104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.448981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:08.450216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:08.531421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5cb-45f5-42ad-8a63-b6741b367b19 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.532053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5cb-45f5-42ad-8a63-b6741b367b19 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.532053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bf5cb-45f5-42ad-8a63-b6741b367b19 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.533586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 371/721] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:08.539466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.539751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.540028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.561425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 351/722] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 15:00:08.562392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:08.564149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:08.594030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:08.654178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 372/723] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 15:00:08.676489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:08.712058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:08.727428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:08.792634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6279b7-8662-4158-979d-e79116b23a5c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:08.809366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef2b15-22b7-43f8-8d05-30d6cfe5eae2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:08.845847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:08.846558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.846840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.847270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.848120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:08.849495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:08.868770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:08.869891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:08.872055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:08.872055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:08.882371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:08.890628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:08.892789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:08.894853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 352/724] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:08.901771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:08.983295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 373/725] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:08 2022] POST /identity/v3/services => generated 251 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:09.021000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de871c-42e4-4511-8334-6067da1f9de1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:09.058099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:09.092087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:09.092715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.093251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.093545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.094410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:09.095263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:09.096782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e2971-d6b3-4dae-abd8-1dda8c9a40d3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:09.109921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 353/726] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:09.116157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.193563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054403fd-7644-4a8d-9b1b-fcb132295f9c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.193926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054403fd-7644-4a8d-9b1b-fcb132295f9c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.194207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054403fd-7644-4a8d-9b1b-fcb132295f9c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.195758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 354/727] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:09.203412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.203412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.203412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.232993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:09.234789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:09.255486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:09.270494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d144e-eafd-45cc-be43-10f8b746798f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:09.327430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 355/728] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 24 15:00:09.350769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:09.351567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.351851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.352119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.357534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.365985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:09.367508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:09.387179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:09.388175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:09.389656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:09.389656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:09.389656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:09.389656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:09.389656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 374/729] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:09.395564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.567507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679de1b-4a3f-4422-8af9-563e9138248b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:09.593895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:09.639838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:09.641024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.641541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.642074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.644660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18bc7cc-17a1-4121-88f8-556c1999133f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:09.668628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:09.677154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:09.678131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:09.678959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:09.691834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 356/730] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:09.701754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.723461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:09.724138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.724422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.724702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.725437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:09.725757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:09.727145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:09.752949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 375/731] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:09.757990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.771377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:09.825641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31fd4-26bd-4550-a829-c2ba3bdced54 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:09.870202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:09.870877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:09.871156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:09.871426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:09.872180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:09.872484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:09.873892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:09.894905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 357/732] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:09.899427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:09.938179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:09.983766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c2227d-7de3-4a6f-a60d-f43e3547cc1e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.021543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.022850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.023369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.023795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.028633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdf034f-3c0a-43a3-be51-d73604bc8e55 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.032809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.034560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5b427d82-478c-4234-bb3a-5faefae19c4f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:10.051211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:10.052212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:10.053164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 376/733] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:10.054810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c77c6-8f07-4411-91d1-135e9a5f60e5 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.054810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c77c6-8f07-4411-91d1-135e9a5f60e5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.054810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c77c6-8f07-4411-91d1-135e9a5f60e5 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.056007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 377/734] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:10.067065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.067344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.067469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.067672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.068146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.068423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.068852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.080640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.082259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.087349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:10.088832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:10.101477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:10.102594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:10.103462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:10.103462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:10.103462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:10.103462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:10.103462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 358/735] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:10.104177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.162299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.171715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 378/736] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 15:00:10.173371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.228020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.243275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d4a1a-e45e-4dfe-9b84-904aba4491cf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.284287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.284947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.285223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.285489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.286343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:10.286773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.288072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.289439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f6f612-22c1-4876-af6b-54f334023463 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.309875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 359/737] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:10.311004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.326372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.327036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.327320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.327596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.328319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:10.328626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.330068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16433083-07d1-4922-91c5-6ca91008fe71 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.341964 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 379/738] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:10.343215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fb9d-5aa9-4870-bd1e-815f3f56bc97 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.343501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fb9d-5aa9-4870-bd1e-815f3f56bc97 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.343778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187fb9d-5aa9-4870-bd1e-815f3f56bc97 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.349062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 380/739] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:10.349062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187fb9d-5aa9-4870-bd1e-815f3f56bc97 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.408417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.425677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23422c85-6789-42b0-88cb-0e929c43d5db None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.512078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187fb9d-5aa9-4870-bd1e-815f3f56bc97 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.514035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.514832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.515115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.515389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.531279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:10.540058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:10.541063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 360/740] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:10.542341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.546864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.558678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.559471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.569117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.569117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.636721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.638246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.665150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b0131-f2b1-4490-be58-cbeb7f99c3ac None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.699299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.700491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.701277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.701553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.701852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.711042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.712474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-43d00e3c-73f7-47a7-8dd4-e4ab8ad173d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:10.726379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:10.727353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:10.728296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 361/741] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:10.728873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.729487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.729487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.746898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:10.748044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:10.758030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 381/742] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 24 15:00:10.758030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.814207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.825764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 362/743] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 24 15:00:10.825764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.866244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923c48c-62bf-417d-bcd8-8f4128ee9056 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.902974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.904155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.904646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.905128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.906170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:10.906549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.907924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.921186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 382/744] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:10.922157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:10.934659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eed8a2-adce-4974-8b90-424346bee246 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:10.942078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:10.970830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:10.971418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:10.971696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:10.971963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:10.972790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:10.973090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:10.974546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:10.997630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 363/745] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:10.997630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.031301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c20da-5334-46f3-8101-a63d4d57d469 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.053560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.066381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.067182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.067465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.067738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.079344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.080898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:11.098226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:11.099342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:11.100462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:11.100462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:11.100462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.100462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:11.101054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 383/746] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:11.101054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.109624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd6ba7-b6cd-4d13-8703-f6e3da3dd256 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.147416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.148403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.148681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.148952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.149674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.151118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.176634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.210051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157764f-e55d-4c5e-9037-0fc395942c5b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.246667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.247479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.247788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.248097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.259909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.261365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.275031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 364/747] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:10 2022] POST /identity/v3/services => generated 240 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:11.276084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:11.278464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:11.279410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 384/748] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:11.285795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.425762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95053f5-374f-40f6-9a0a-bb34fc37897d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.426257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66660c85-f869-4405-81fa-c6a9f0dd9938 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.437428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.465209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.465209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.465480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.465827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.478046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.479750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.504944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:11.512103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:11.513079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 365/749] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:11.515069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.525974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.526639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.526926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.527206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.527952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:11.528263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.529666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162d09f-8c82-4020-9dbe-115c8716a08c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.543178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 385/750] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:11.544501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06fdf-086c-4dce-a26f-0deb9a3b0f6e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.544784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06fdf-086c-4dce-a26f-0deb9a3b0f6e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.545062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a06fdf-086c-4dce-a26f-0deb9a3b0f6e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.546504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 386/751] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:11.547033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06fdf-086c-4dce-a26f-0deb9a3b0f6e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.630046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86067d1c-08a3-4c81-a268-4a604c3fca3d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.659775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a06fdf-086c-4dce-a26f-0deb9a3b0f6e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.668104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.668778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.669040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.669310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.670056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:11.670359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.671771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.688935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 366/752] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:11.689673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.697394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.698142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.698418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.698717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.699434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:11.699961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.701187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444141ef-0f36-4109-85c3-d214a97e24c4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.713046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 387/753] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:11.714215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.716281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.716780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.717963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.735140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:11.736296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:11.776582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.798259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16e470-06e2-4f58-99f3-911e622a40ea None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.822062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 388/754] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:11.823053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.842102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.842899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.843177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.843450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.851360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.852811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:11.866548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:11.867502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:11.868395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 367/755] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:11.870120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:11.932009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b7985-270e-4877-aaa6-23e36963a72e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.960558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:11.971116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:11.978489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:11.978489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:11.978489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:11.980649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:11.982134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:11.982697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef017fde-92c2-472b-9802-a4167ffa39ab None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:11.998185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:11.999403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:12.000592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:12.002666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 389/756] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:12.003581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.023266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.024062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.024342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.024638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.031618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.033616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.042401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:12.048105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:12.049169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:12.050379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:12.056890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 368/757] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:12.056890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.119885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8d8b1-dd28-410c-b50d-39efb4ee4865 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.156531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.157761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.158292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.158707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.159499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.161272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.163640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bd10-e08d-4e4c-a987-06733a2e84de None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:12.174369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:12.175500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:12.176533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:12.177330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 390/758] 10.222.0.65 () {56 vars in 1129 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:12.177568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.208189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.209210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.209497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.210075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.211060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:12.211377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.213441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.225578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.234784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 369/759] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:12.234784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.282803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.292066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62525b66-4905-4a6d-87ae-7942918c1341 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.330699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.331376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.331659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.331938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.332771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:12.333083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.334570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.342904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8785b2-f303-411e-8795-5b3fdc4ccd0e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.352169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 391/760] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:12.353247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.384103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.384820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.385103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.385374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.386341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:12.386763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.388234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.401028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 370/761] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:12.401910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.488646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.493212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949a20-5b04-4dd3-8256-ff6e6956f35a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.531212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.531834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ada43-aa0b-42f7-bf86-5f9a63a67be4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.532031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.532261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.532678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.533693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:12.534006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.536159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.546478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 392/762] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:12.546478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.566946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.567697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.567847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.568117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.568771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.569616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=bd11123cb5a64281b8c0336ee2a56f0d) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:12.569959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.571391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.577517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 371/763] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/role_assignments?user.id=bd11123cb5a64281b8c0336ee2a56f0d&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:12.586931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.675476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961fcb5c-6ce1-4b43-937c-37f9b696ee4f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.719217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.721394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.721861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.722339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.726578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d99f24-5585-4b11-bbf0-9391ab04a93a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:12.755195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.769392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:12.770824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:12.771119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:12.771653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:12.773674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=ecc895f2eaa245dc8f1b5d811a4c88e0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.776367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.812912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:12.814655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:12.833476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:12.845174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 372/764] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:12 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:00:12.846959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.956778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 393/765] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:00:12.962152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:12.973549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23474a-8eb2-4601-a23c-3796597c8bdd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.015958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.016996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.017640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.018398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.019451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:13.020060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.021982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.028531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 373/766] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:13.035453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.102599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e14bf-8c39-4e92-aeac-5e45a15633dc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.127996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.144345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.151301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.151301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.151301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.151726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.166185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.168072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.191701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5a61e-0078-49cd-a64e-2fade8fff68a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:13.192233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:13.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:13.194367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:13.194367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:13.194367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:13.194367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:13.198670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 394/767] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:13.206884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.260554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.261878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.262342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.262785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.263802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] RBAC: Adding query filter params (interface=public, service_id=0b77b58c7d8746ab90e3e90615e4354c, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:13.264306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.265945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.289043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 374/768] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/endpoints?service_id=0b77b58c7d8746ab90e3e90615e4354c&interface=public®ion_id=RegionOne => generated 194 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:13.295262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.339638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b524a-2fb6-4811-bf0a-5a45c99c3a44 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.427102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.427719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.428064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.428340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.429064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:13.429380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.430786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.454726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 395/769] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:13.461337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.500215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6d162-44b7-4ef3-b323-147538e74c70 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.514887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.526132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.537833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.538502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.538781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.539053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.539735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.541102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c67af-1a73-4119-8b44-bbc1137b9246 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.554167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 375/770] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/services => generated 772 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:13.555722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84e13-b413-43aa-a1e9-1095f36e47de None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.556012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84e13-b413-43aa-a1e9-1095f36e47de None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.556289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84e13-b413-43aa-a1e9-1095f36e47de None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.557821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 376/771] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:13.569376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.569648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.570032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.613634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:13.615087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:13.619685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59a382-af11-43c5-8d94-c438a86ca871 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.681580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.682339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.682620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.682892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.694893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:13.696489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:13.730947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:13.732342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:13.733602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:13.739814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 396/772] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:13.747001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.769745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 377/773] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jun 24 15:00:13.790829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:13.895563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.933296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd009212-0159-4d08-a4e3-880554604383 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.946269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9667db-6de6-4afd-98cc-52d8735cba16 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:13.955492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:13.985703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:13.986880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:13.994469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:13.994751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] PATH_INFO: `/v3/services/network` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:13.995454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.001534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.018108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.018772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.019054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.019333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.020127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:14.020436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.021898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:14.027555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:14.028540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:14.029395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:14.033343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 378/774] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/services/network => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:14.040668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:14.050221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 397/775] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:14.056338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:14.249151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e67c96-8a7c-4be5-9105-130295db3630 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:14.267706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729a1d0b-2937-48c6-993b-e433286e7768 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:14.319231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.321243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.321525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.321823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.322542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] RBAC: Adding query filter params (name=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:14.322847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.324219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.336078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 379/776] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:14.341698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.342375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:14.342488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.342675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.342937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.343807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=4d6c4a1de21c4f1893e73c8d7f81a62e) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:14.344094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.346112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.352944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 398/777] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:14 2022] GET /identity/v3/role_assignments?user.id=4d6c4a1de21c4f1893e73c8d7f81a62e&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:14.406738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:14.502634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bd0d5-a025-4a96-bee9-710297532e00 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:14.559779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.560830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.561347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.561860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.562827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:14.563390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.564997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.574326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 380/778] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:14.580484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:14.602097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:14.707577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495ab3-4c26-4a06-9282-408871ecb728 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:14.761258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.761908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.762191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.762465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.763319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] RBAC: Adding query filter params (interface=public, service_id=37777b4ffcfe4e7f9c0c35393ce5cc30, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:14.763629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.764999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d5ef9-bf85-45b0-80b8-36380c1d032a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.773639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 399/779] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:14 2022] GET /identity/v3/endpoints?service_id=37777b4ffcfe4e7f9c0c35393ce5cc30&interface=public®ion_id=RegionOne => generated 194 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:14.783410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:14.924012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:14.927962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a2bb6-f571-4eb9-ad52-3d9332dbefd5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:14.982450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:14.983116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:14.983384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:14.983660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:14.984351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:14.986315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b4d98-90f4-4ab5-988e-6e7533aaf53e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:14.994974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 381/780] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:14 2022] GET /identity/v3/services => generated 772 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:15.055383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6054a-abd0-4fe9-a788-4361a6824a09 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.055685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6054a-abd0-4fe9-a788-4361a6824a09 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.055871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6054a-abd0-4fe9-a788-4361a6824a09 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.057524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 400/781] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:15.063215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ddff-f232-4809-b093-604cf316405e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.063500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ddff-f232-4809-b093-604cf316405e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.063785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2ddff-f232-4809-b093-604cf316405e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.081841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-79f2ddff-f232-4809-b093-604cf316405e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:15.083204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-79f2ddff-f232-4809-b093-604cf316405e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:15.187860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 382/782] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:15.213045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6054a-abd0-4fe9-a788-4361a6824a09 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:15.318609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:15.346074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6054a-abd0-4fe9-a788-4361a6824a09 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:15.348298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddb38-d0be-4ddd-9214-22739ae29ed5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.348587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddb38-d0be-4ddd-9214-22739ae29ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.348867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ddb38-d0be-4ddd-9214-22739ae29ed5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.350544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 383/783] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:15.356053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.356339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.356620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.376049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:15.377235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:15.393432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:15.395399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.395688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.395969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.413304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:15.421128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:15.422121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:15.423707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 401/784] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:15.428478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:15.502814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 384/785] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:15.542970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:15.573131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec026e-f05e-443e-961f-d53680981d2c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:15.582080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:15.632800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:15.633486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.635463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.635809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.636597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:15.636910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:15.638349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:15.647875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:15.661501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 402/786] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:15.667408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:15.746838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7cfa8-fef3-4bf8-8b71-0ad455517c90 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:15.789899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:15.790696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.790977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.791248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.820937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:15.833513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:15.834490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:15.835344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:15.842363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 385/787] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:15.847883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:15.858835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17de415-5836-4ea5-9ab9-2aec6a187710 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:15.974068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4246da-ab68-4d45-aa1d-37e55fb8a5ea None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:15.974445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:15.975260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:15.975543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:15.975817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:15.976430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.005503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.007704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:16.033112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:16.034176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:16.035406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:16.035406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:16.035406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:16.035406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.035406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 403/788] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:16.037024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.040998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.040998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.040998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.040998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:16.040998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.041388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.043569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.056140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 386/789] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:16.061125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.122882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.178381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30410399-c4f0-44cb-b8a7-f2c8f210a658 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.197935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e5deeb-f529-46e8-b24e-f02395d3ba62 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.217764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.218421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.218703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.218992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.219728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:16.220091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.223411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbddc16-9811-45a1-a199-3ab492e510a6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.238354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 404/790] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:16.238354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3baafa-2a0f-4b5b-ad42-009f24e8f564 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.238354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3baafa-2a0f-4b5b-ad42-009f24e8f564 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.238354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3baafa-2a0f-4b5b-ad42-009f24e8f564 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.238354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 405/791] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:16.241739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3baafa-2a0f-4b5b-ad42-009f24e8f564 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.257846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.258691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.259066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.259435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.271404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.273079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.276188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1b6ce730-5b41-415d-9217-279a732d648a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:16.292754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:16.293802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:16.294816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:16.294816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:16.294816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:16.294816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:16.294816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 387/792] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:16.296721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.296849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.297192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.316449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:16.317764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:16.362138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3baafa-2a0f-4b5b-ad42-009f24e8f564 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.376960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.402286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 388/793] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:16.402286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.416712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.417523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.417870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.418151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.435404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.437281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:16.454114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:16.455385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:16.456334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.463829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 406/794] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:16.465288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.530110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a076b-0018-47e6-8d5f-2551985d8864 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.559150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.568629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.570577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.570577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.570577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.570805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:16.571222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.572512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.577223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef58ee-daf2-4b91-8e0d-32aecb792741 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.585112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 389/795] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:16.585996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.616325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.617611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.618170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.618638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.619857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.621564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:16.634741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:16.635683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 24 15:00:16.636514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.639185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 407/796] 10.222.0.65 () {56 vars in 1129 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:16.640313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.678101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.711157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8750bf-c18f-4167-b0f1-3999ce7715da None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.758102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca39209-63e3-4970-8c8e-f8d88f7f474d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.759141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.759816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.760100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.760376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.761390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:16.761690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.764102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.788583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 390/797] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:16.789785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.803712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.804517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.804927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.805220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.815742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.817620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:16.833470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:16.834512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 408/798] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:16.836056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.845335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.904280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ad290-6bc9-4992-900f-9d8176559b1e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.937204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:16.943217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.943878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.944159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.944427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad1fe9-f594-431a-97b5-f9a89be8a6cc None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:16.944526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.945187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:16.945494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.947280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:16.956396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 391/799] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:16.956396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:16.979993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:16.980809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:16.981087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:16.981364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:16.993780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:16.995500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fe3cc5d5-40f7-4176-afc5-bc061678f251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:17.014191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:17.015191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:17.016188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:17.016188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:17.016188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:17.016188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:17.020697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 409/800] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:17.022089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1146e-751e-4d14-9edc-7a34c73eeaaa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.022890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1146e-751e-4d14-9edc-7a34c73eeaaa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.023540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da1146e-751e-4d14-9edc-7a34c73eeaaa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.030397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 410/801] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:17.031362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1146e-751e-4d14-9edc-7a34c73eeaaa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.149502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da1146e-751e-4d14-9edc-7a34c73eeaaa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.185999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.186622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.186913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.187179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.187946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:17.188752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.190165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.190498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90171281-1c37-45c2-9615-169dd58ceaff None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.197565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 411/802] 10.222.0.65 () {56 vars in 1124 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:17.198424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.205414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.217433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.232640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.233318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.233586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.233891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.235228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:17.235611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.236944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7259acf8-fc30-4f85-b735-4763a1352fe5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.255959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 392/803] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:17.257272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.257556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.257858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.274031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:17.275209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:17.325315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b5c56-d1f3-4e50-88db-2bc3f7cafb48 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.358796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.359449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.359765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.360579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.361435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:17.361757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.363057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.364902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 393/804] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:17.373899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.379993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 412/805] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:17.381036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.463422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.479490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.485794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b1371-f8c1-4c2b-9155-1aad49942707 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.493891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b4fb7-f21e-4a5e-93d3-245cc40bf681 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.519394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.520048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.520325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.520597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.521333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.522766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.528562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828add39-4443-4830-926a-488a5c860e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.529212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828add39-4443-4830-926a-488a5c860e72 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.529497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828add39-4443-4830-926a-488a5c860e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.529812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828add39-4443-4830-926a-488a5c860e72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.596488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828add39-4443-4830-926a-488a5c860e72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.597966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828add39-4443-4830-926a-488a5c860e72 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.633105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 394/806] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:17.650068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.669950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.703283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 413/807] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:00:17.705026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828add39-4443-4830-926a-488a5c860e72 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.776378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051a5f4-de6e-4068-8c57-c80f5377eccd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.811502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828add39-4443-4830-926a-488a5c860e72 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.822598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.823175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.823441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.823712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.832048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:17.833514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0ded09c2-b4e7-42b4-833b-00db73388f84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:17.849457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:17.850522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:17.851412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:17.853244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 395/808] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:17.854636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:17.855426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.855705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.855973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.860110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9766-e60d-4f2e-b2ea-681c5aa7e5e8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:17.860382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9766-e60d-4f2e-b2ea-681c5aa7e5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:17.860652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dd9766-e60d-4f2e-b2ea-681c5aa7e5e8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:17.864298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 396/809] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:17.864298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd9766-e60d-4f2e-b2ea-681c5aa7e5e8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.871383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:17.876833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:17.879174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:17.880109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:17.880972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 414/810] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:17.881686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:17.915627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:17.978388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dd9766-e60d-4f2e-b2ea-681c5aa7e5e8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:17.987726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14757e0-ca3d-4bfc-b86a-574cdce0a334 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.017480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.018588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.018870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.019150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.022813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.023471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.023752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.024033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.024818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:18.025124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.026644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e1430-5d23-4444-88d9-2c657ea39276 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.029976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.031463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.044743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 415/811] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:18.044743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.044743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.044743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:18.050504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:18.051407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:18.052315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:18.052315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:18.052315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:18.052315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:18.056205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 397/812] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:18.057120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.065460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:18.067192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:18.122131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.149772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 416/813] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:18.150512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.166585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22be293d-dc8f-471e-afb0-c325dfd9d663 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.179950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.204184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.204860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.205138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.205405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.206193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:18.206493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.207887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.216843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 398/814] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:18.222491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.275110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e64752-13f7-4273-b013-695bdb3a0e56 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.310594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.311461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.311842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.312216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/bd11123cb5a64281b8c0336ee2a56f0d/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.314893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=bd11123cb5a64281b8c0336ee2a56f0d, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.316428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.334251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a478d32-b8a6-4d35-8b35-0c65df206910 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.377333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.385879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 417/815] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:18 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/bd11123cb5a64281b8c0336ee2a56f0d/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:00:18.385879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.401744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.402610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.402940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.403222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.404175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:18.404487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.406051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.420377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 399/816] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:18.421425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.493010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.519388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267e764-477b-40e2-8554-844d326f9f33 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.556154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857065e5-6462-4bd3-906a-0fe1b52ec9c9 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.559290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.560097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.560377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.560710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.561320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.562806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:18.576403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:18.577457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:18.578398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 418/817] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:18.579206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.609433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90273-7117-4a20-b408-318f945711ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.610820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90273-7117-4a20-b408-318f945711ec None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.611115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90273-7117-4a20-b408-318f945711ec None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.611382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f90273-7117-4a20-b408-318f945711ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.624808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f90273-7117-4a20-b408-318f945711ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.627086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f90273-7117-4a20-b408-318f945711ec None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-76f90273-7117-4a20-b408-318f945711ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:18.646469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:18.647427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 400/818] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:18.648304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90273-7117-4a20-b408-318f945711ec None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.699738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.700713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d08b0e-4365-426a-9fbe-77f9ecde6de8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.740401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.741234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.741516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.741838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.749543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.751640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:18.766517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:18.767438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:18.768327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 419/819] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:18.768818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.773857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.796394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f90273-7117-4a20-b408-318f945711ec None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.842646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.843761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.844777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.845258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.846238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:18.846753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.848364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.853891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 401/820] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:18.855215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.887525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd09ca-c94f-4cac-aaa1-988876817e56 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:18.924757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:18.925188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:18.925478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:18.925783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:18.926514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:18.926876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:18.928252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:18.945317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 420/821] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:18.946307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:18.965024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:18.967644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69d2804-5d78-45ed-8df9-c7dc915229e8 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.012056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.013347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.014241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.014954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.016236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:19.016743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.017805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:19.019129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.035732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 402/822] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:19.036609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.076444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e426cb-1f38-40ca-99f2-48b2f8818ade None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.113293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.113993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.114275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.114558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.115264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] RBAC: Adding query filter params (type=network) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:19.115570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.116994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.127784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 421/823] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:19.128711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.161224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62657955-782c-4f96-9708-cc80f5b73b5e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.206509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.208103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.208596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.209063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.218416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.220426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:19.239320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:19.240264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:19.241193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:19.245467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 403/824] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:19.246417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.251899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf127f-fd8d-4b60-99aa-4d8cf5b4e525 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.267727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:19.289099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:19.300238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.301747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.302273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.302749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.303783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:19.304293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.306772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.323781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 422/825] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:19.323781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.399629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2024-90f7-4970-a590-245dca6a9cf1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.436998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6bd59b-4be3-4bbf-ae95-552e00ecb449 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.474079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.475341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.475798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.476248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.477286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:19.477831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.478997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.479659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.479938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.480164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.480281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.481034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.482614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.502990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 423/826] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:19.508528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.576337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 404/827] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:19.581862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:19.638170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce14c0-e99e-4da9-9efc-65cce17ddf52 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.696465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.697195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.697476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.697785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.713442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.714961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f323adcd-288b-49f1-a214-5f556f8d25f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:19.740230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:19.741190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:19.742093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:19.742093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:19.742093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:19.742093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:19.742093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 424/828] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:19.748655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.775731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a590d-444c-4d3c-8a96-9d95b2ee1e51 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.776227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a590d-444c-4d3c-8a96-9d95b2ee1e51 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.777441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a590d-444c-4d3c-8a96-9d95b2ee1e51 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.782382 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 425/829] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:19.789393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.790141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.790646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.816491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:19.817679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:19.855769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:19.889529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1310a80-d56e-4da5-9de2-87585f76d6f3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:19.908408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 426/830] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:19.930910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:19.931573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:19.931862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:19.932138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:19.932920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:19.933232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:19.934714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:19.941709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.954530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 405/831] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:19.960463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:19.976189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:20.051766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5c241-400a-475c-8394-eefc63c0a5dd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.069881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b593c3-c520-4375-877d-c06aca0b5727 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.088475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.089286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.089554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.089859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.090521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.091950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:20.104939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:20.106052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:20.106882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:20.111221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 427/832] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:20.112462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:20.114637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.115753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.116208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.116688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.119345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:20.126742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.128423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:20.144273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:20.145197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:20.146133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:20.148773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 406/833] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:20.153957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:20.210628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:20.220495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85e41-8ddc-40b1-b056-f7db45c5d1cd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.255759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.256469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.257011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.257509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.258729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:20.259037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.260415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.268956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 428/834] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:20.273909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f06c4d-e8a5-4c7e-b6ff-e5eab5516793 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.274559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:20.312526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.314120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.314600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.315070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.316057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:20.316623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.318461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.333178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 407/835] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:20.341875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:20.385067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05974da-78d2-475d-8ff9-80e0db58d0ad None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.408602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:20.427727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.428509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.428746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.429028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.429747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:20.430067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.432126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813d406-dd82-4118-ae15-9c4af58a5c06 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.443211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 429/836] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:20.473511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a6d621-da85-4c5e-aaec-963f3f186816 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.512538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.513444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.513744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.514027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/4d6c4a1de21c4f1893e73c8d7f81a62e/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.535508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=4d6c4a1de21c4f1893e73c8d7f81a62e, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:20.536977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1861b-2fa6-4a60-ac72-40a6ec2d8827 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:20.646770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 408/837] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:20 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/4d6c4a1de21c4f1893e73c8d7f81a62e/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:00:20.661112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0cd7-83cc-4949-a319-5de580078cee None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.661446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0cd7-83cc-4949-a319-5de580078cee None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.661739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc0cd7-83cc-4949-a319-5de580078cee None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.663176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 430/838] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:20.669169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.669603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.670002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.689548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:20.690864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:20.774442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 409/839] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:20 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:20.799574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0cd7-83cc-4949-a319-5de580078cee None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:20.825404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:20.910734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc0cd7-83cc-4949-a319-5de580078cee None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:20.948397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:20.949197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:20.949478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:20.949777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:20.961064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:20.968666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:20.969668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:20.970980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 431/840] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:20.976061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.011472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:21.080436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb22d4-0071-4b8c-aef5-bae4b7d0ba43 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:21.119633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:21.120317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.120600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.120878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.121631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:21.121967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:21.123346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:21.132939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 410/841] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:21.138204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.231539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:21.252033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f40dfd-50b5-40f9-b261-e4055e172b62 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:21.289905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:21.290696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.290969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.291243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.302601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:21.304043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:21.322085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:21.323097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:21.323986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:21.323986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:21.323986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:21.323986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:21.323986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 432/842] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:21.329039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.430463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:21.436488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c673f-230f-494e-9d0d-ef1baf8531f4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:21.482217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:21.482882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.483160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.483439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.484165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:21.484469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:21.485857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:21.498531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 411/843] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:21.504064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.610833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ebc81-1732-4d82-92a6-33741b13cc58 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:21.646500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:21.651386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:21.652181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.652457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.652731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.661557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:21.663177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-62bb7db8-0b89-4105-9f35-5d3fec4e2247 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:21.677412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:21.678441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:21.679391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 433/844] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:21.686975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.796084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e2881-908a-4a74-bd84-d16509df4fb7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:21.833095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:21.834238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.834728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.835224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.836311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:21.836878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:21.838586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:21.841597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3ab2-49bc-49e3-a42e-0b9ec6aa7c6d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.841926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3ab2-49bc-49e3-a42e-0b9ec6aa7c6d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.842213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd3ab2-49bc-49e3-a42e-0b9ec6aa7c6d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.843794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 434/845] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:21.849619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:21.849965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:21.850201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:21.861939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 412/846] 10.222.0.65 () {56 vars in 1135 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:21.867329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.872404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:21.873856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:21.883612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:21.951970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 435/847] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:21.978392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:21.991593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67150d02-1fa4-433a-9f51-a73e20c356b7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.032422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.033548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.034068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.034569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.107437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b04d93-0cc0-462d-a642-d439cdde3290 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.109246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.111087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.128414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.138667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.154330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.155156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.155441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.155720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.156415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.157837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:22.175001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:22.176181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:22.177204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:22.181808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 436/848] 10.222.0.65 () {56 vars in 1132 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:22.183958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.253882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 413/849] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:22.259542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.310549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81dd82c-874f-4914-ade0-73d95186fbde None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.347309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.348346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.348837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.349320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.350369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:22.350912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.352612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.358057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 437/850] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:22.364023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.397281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176475a-c30c-4467-a903-d3c817878baa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.415732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.418252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.442340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.443132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.443413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.443684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.457916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.465017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:22.482486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:22.483426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:22.485368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:22.485368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:22.485368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:22.485368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:22.489155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 414/851] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:22.490477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.493265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86500f3f-f2af-4472-a9e8-37f4d0003a60 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.536839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.538079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.538630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.539112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.540025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:22.540535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.542288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.553466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 438/852] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:22.613403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc52f0c-c3f2-4916-945a-9726f921753f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.652156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.652831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.653121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.653394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.654172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:22.654480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.655872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29122679-1703-4357-90ec-cba861d8b4b6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.670528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 415/853] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:22.678979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.694678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f982-9247-4ac0-880d-92edcd8486ab None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.695014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f982-9247-4ac0-880d-92edcd8486ab None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.695232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791f982-9247-4ac0-880d-92edcd8486ab None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.698255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 416/854] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:22.703045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d140d-9577-4a29-87cc-b5145750fba0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.703339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d140d-9577-4a29-87cc-b5145750fba0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.703613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d140d-9577-4a29-87cc-b5145750fba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.727058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8a4d140d-9577-4a29-87cc-b5145750fba0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:22.728250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8a4d140d-9577-4a29-87cc-b5145750fba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:22.754833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.798824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b17be93-8596-4411-8bcc-c02e0cdebb21 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:22.813984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 417/855] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:22.815610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2bcd-176b-4498-beb0-21750d57bd9d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.815971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2bcd-176b-4498-beb0-21750d57bd9d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.816327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2bcd-176b-4498-beb0-21750d57bd9d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.817831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 418/856] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:22.822291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:22.823078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.823453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.823803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.842277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:22.843470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:22.849112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:22.851139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:22.851633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:22.852504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:22.862230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:22.864293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:22.881207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:22.882229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 439/857] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:22.883121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:22.926514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 419/858] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:22.927194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.023667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:23.040325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262748d4-6990-4866-8108-75ac4d8011b4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.076320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.076992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.077266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.077566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.078914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:23.079217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.080646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.095966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 420/859] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:23.096905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.121972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdd9fe-6967-45cc-971b-a32d9c90beed None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.155614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.156905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.157113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.157383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.158205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.159592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.207059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aebce5-1452-4ca8-abb2-a12a6f59997d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.219673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 440/860] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:22 2022] POST /identity/v3/services => generated 251 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:23.226026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.271939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.272759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.273064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.273338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.278341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:23.288016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:23.296123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:23.297199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:00:23.298101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:23.302147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 421/861] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:23.303792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.307502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:23.362589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd7cd4-25d4-4987-9f14-e05fcb241ea9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.402924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.403949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.404453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.404894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.405985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=bd11123cb5a64281b8c0336ee2a56f0d) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:23.406499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.408016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.414757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 441/862] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/role_assignments?user.id=bd11123cb5a64281b8c0336ee2a56f0d&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:23.426514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc4f01-8f9c-449d-b7ab-eb2b4a342256 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.469377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.470131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.473799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.473799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.473799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:23.473799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.473799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.487827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 422/863] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:23.493921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.603646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:23.607511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6214e8d0-917f-49af-8377-08ea90ab79c7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.643031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.643829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.644139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.644421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.655984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.657478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:23.676918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:23.678006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:23.678996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:23.678996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:23.678996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:23.678996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:23.678996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 442/864] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:23.684144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.753123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:23.791534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cf5388-e7fe-4d18-a652-a1e5740b98ed None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.828392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.829056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.829332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.829603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.830349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:23.830648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.832011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:23.844945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 423/865] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:23.850109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:23.953939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707ac50-ca88-4929-94fb-fce6b34e596c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:23.988444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:23.989255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:23.989535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:23.989841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:23.997976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:23.999424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:24.014304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:24.015339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:24.016861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 443/866] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:24.022103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.132301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb0fb4-4a41-4a9a-be2c-057ef00226b2 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:24.157196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:24.168866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:24.170897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.170897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.170897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.171132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:24.171313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:24.172768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:24.192510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 424/867] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:24.197970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.262179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:24.330154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe4f9a-3eb5-4312-afdc-a4d7d63ac152 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:24.367858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:24.369156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.369641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.370168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.442927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:24.444746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e22cd-eb3f-4535-87b0-640ef8f80694 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:24.456656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:24.551765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 444/868] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:24 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:00:24.557195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.665136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b331c-3bc6-41a5-b544-4da0e79316a4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:24.673804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bdb0-b677-4959-ab5c-4a361a3d9eca None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.674098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bdb0-b677-4959-ab5c-4a361a3d9eca None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.674366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1bdb0-b677-4959-ab5c-4a361a3d9eca None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.675753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 445/869] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:24.681040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.681322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.681593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.701967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:24.703185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:24.708636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:24.709431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.709708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.710015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.721104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:24.722770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:24.744160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:24.745105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:24.746022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:24.746022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:24.746022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:24.746022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:24.746022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 425/870] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:24.754607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.786466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 446/871] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:24.792199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:24.809191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.856222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:24.879703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595bb84-6cf9-4235-b550-3bcf94c3bba1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:24.914449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e64ab-8726-41a1-8018-57b957da14ed None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:24.924561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:24.925261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.925576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.926225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.926717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:24.927020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:24.928368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:24.945108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 426/872] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:24.946400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:24.961092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:24.961772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:24.962051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:24.962619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:24.963034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:24.964505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.053062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:25.061837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 447/873] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:24 2022] POST /identity/v3/services => generated 269 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:25.066789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8153c3d1-939c-44b9-9916-43784d43c6ac None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.115313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.116180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.116469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.116796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.125212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.126723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:25.142671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:25.144174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.145111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 427/874] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:25.150224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.279730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:25.284695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493238b-f37a-4e07-bf55-6d0cec7d16c5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.319641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.320242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.320523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.320792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.321593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:25.321935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.323385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f4538a-6692-4065-9f9e-ed71d270c3a2 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.337990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 448/875] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:25.344499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.458864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e2f90-0afb-4d0c-9d37-7ed69d47a486 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.476704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c726-eaf6-408f-a18e-c1cbcdee4f3c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.477169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c726-eaf6-408f-a18e-c1cbcdee4f3c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.477691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92c726-eaf6-408f-a18e-c1cbcdee4f3c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.480805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 449/876] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:25.486689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e4e-1580-485f-b592-e75f0b39b63e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.486975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e4e-1580-485f-b592-e75f0b39b63e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.487260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da24e4e-1580-485f-b592-e75f0b39b63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.499994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.501090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.501765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.503437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.507289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=4d6c4a1de21c4f1893e73c8d7f81a62e) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:25.507844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.509531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.511303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6da24e4e-1580-485f-b592-e75f0b39b63e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:25.512881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6da24e4e-1580-485f-b592-e75f0b39b63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:25.526085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 428/877] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/role_assignments?user.id=4d6c4a1de21c4f1893e73c8d7f81a62e&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:25.596899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 450/878] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:25.620276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.638851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:25.684714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023336-8316-44ce-a273-430ffe903904 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.685036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023336-8316-44ce-a273-430ffe903904 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.685251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4023336-8316-44ce-a273-430ffe903904 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.686899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 451/879] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:25.692626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.692912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.693186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.713464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:25.714677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:25.736876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08f2a6a-a386-4f3f-9e77-67808f95b967 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.775092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.775986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.776266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.776533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.777275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.778564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.789141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 452/880] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:25.793050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:25.794074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.795288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 429/881] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:25.800508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.814114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.823216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:25.903366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:25.926168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438551a2-352d-4e89-b626-0730b140f7ce None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.928002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd3913-d391-4c84-bcdd-a8ad22966f77 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:25.963609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.964391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.964847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.965184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.965950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.967455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.973377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:25.974316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:25.974836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:25.975246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:25.976085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:25.976539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:25.978130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:25.980965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:25.982157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:25.983176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:25.986031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 430/882] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:25.987509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 453/883] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:25.994702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:25.994873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:26.086641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:26.104136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3772490-9c94-4c8d-a1b8-e4c67353ba70 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:26.122978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f6a70-7a52-4186-aae8-16ce99ecde7f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:26.142961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:26.143825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:26.144185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:26.144533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:26.145418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:26.145814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:26.147323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:26.158035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 454/884] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:26.159498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:26.175371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:26.176834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:26.177393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:26.177984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:26.179063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:26.179943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:26.181785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:26.189113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 431/885] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:26.194746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:26.208536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:26.289980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a55-4c23-4639-98f6-e903c315cd95 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:26.330185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59642422-2411-41a6-88ff-58b714579537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:26.330996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642422-2411-41a6-88ff-58b714579537 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:26.331406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642422-2411-41a6-88ff-58b714579537 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:26.331782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59642422-2411-41a6-88ff-58b714579537 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:26.332681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59642422-2411-41a6-88ff-58b714579537 None admin] RBAC: Adding query filter params (interface=public, service_id=1ead343375124037a7a694751c942fee, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:26.333085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59642422-2411-41a6-88ff-58b714579537 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:26.334597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59642422-2411-41a6-88ff-58b714579537 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:26.339388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cecab1-fcf3-4486-a64d-df4ab12c1d23 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:26.345264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 455/886] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:26 2022] GET /identity/v3/endpoints?service_id=1ead343375124037a7a694751c942fee&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:26.347424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59642422-2411-41a6-88ff-58b714579537 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:26.369684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:26.382070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:26.382803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:26.383085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:26.383362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:26.384194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:26.384418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:26.385814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991f723-3e82-405d-b30f-268f328bbac5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:26.397896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 432/887] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:26 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:26.473869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59642422-2411-41a6-88ff-58b714579537 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:26.513334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:26.514408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:26.514908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:26.515555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:26.516492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:26.518205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d5093d-6fa0-4cc2-8995-a8e96d528a1e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:26.525306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 456/888] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:26 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:00:27.234119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866eb03-c026-42b8-ae5f-4c1766257b71 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.234674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866eb03-c026-42b8-ae5f-4c1766257b71 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.234674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866eb03-c026-42b8-ae5f-4c1766257b71 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.236345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 433/889] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:27.242182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.242488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.242746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.260940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:27.262484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:27.335361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 457/890] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:27.357816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866eb03-c026-42b8-ae5f-4c1766257b71 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:27.443837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:27.478993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866eb03-c026-42b8-ae5f-4c1766257b71 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:27.518066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:27.519240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.519748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.520288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.521194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:27.523028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:27.537164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:27.538211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:27.539047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:27.542130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 434/891] 10.222.0.65 () {56 vars in 1132 bytes} [Fri Jun 24 15:00:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:27.550776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:27.558156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:27.654852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50949339-b881-4325-9a9a-972d71c9a193 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:27.691317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:27.692385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.692870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.693383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.694379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:27.694919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:27.696562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf2c3b-097d-42c0-bce3-b212e0025405 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:27.702684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 458/892] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:27.710946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:27.803481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0751f-2388-4675-b71e-f71acc246c5b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.803689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0751f-2388-4675-b71e-f71acc246c5b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.803939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f0751f-2388-4675-b71e-f71acc246c5b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.805532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 459/893] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:27.811928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.812765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.813028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.829609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b62797-ba2d-4fe7-908b-f8cffbaf9640 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:27.833072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:27.834552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:27.880547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:27.881299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:27.881581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:27.881880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:27.882593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:27.882895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:27.884254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:27.886115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:27.891744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 435/894] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:27.897608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:27.918541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:27.928834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 460/895] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:27.947472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.024886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5a152-a055-4e54-8aa0-576d2587f8e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.049502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a56958-df42-4159-91ea-74252f6a0588 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.068747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.069673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.070179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.071078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.072319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] RBAC: Adding query filter params (interface=public, service_id=4751d2f33694464f8eccb7459e8a28bc, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:28.072807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.075128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.088190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 436/896] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:27 2022] GET /identity/v3/endpoints?service_id=4751d2f33694464f8eccb7459e8a28bc&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:28.089208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.095275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.096089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.096368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.096641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.107679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:28.116283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:28.117263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:28.118124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:28.122005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 461/897] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:28.123542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.170623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:28.187947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:28.222314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef1545-22fb-4e52-9d69-54314ad8f256 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.236480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc4f229-1b1f-451d-b319-6154c9130562 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.260483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.261329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.261617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.261919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.263116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.265870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.274956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 437/898] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/services => generated 1268 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:00:28.285546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.286275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.286600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.286878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.287648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:28.287950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.289370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.300473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 462/899] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:28.306329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.416709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb365e28-ed36-4590-aa95-db4ba599cd44 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.445329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:28.459587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.460383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.460659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.460934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.475201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.476645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-fda202ee-6111-4949-a5de-a08ffc6e7e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:28.498464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:28.499421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:28.501016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:28.501016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:28.501016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:28.501016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:28.501016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 438/900] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:28.507281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.536379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350853-7d83-4042-aa9d-094330c5931c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.536582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350853-7d83-4042-aa9d-094330c5931c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.536740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3350853-7d83-4042-aa9d-094330c5931c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.539378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 439/901] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:28.543601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.543885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.544166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.565553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:28.567326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:28.624879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7959cb01-7c89-4e50-ae5d-2dd5e8cbc574 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.644643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 440/902] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:28.658733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:28.674936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.675124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.675208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.675208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.675208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.676659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:28.676973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.678545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.694634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 463/903] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:28.700009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.785739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921efbc-1177-4bf5-87ad-279a57e3c7bd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.795189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:28.819432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a63505-0001-463b-a8ef-b6f5bae7f15a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:28.820681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.821357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.821640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.821989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.822713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.824101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.854968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:28.855783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.856052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.856320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.864117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:28.865532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-1dd853f0-6072-45ba-a8c6-c922c3311222 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:28.880368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:28.881399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:28.882372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 464/904] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:28.883247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698948-d5d6-4e3c-9618-6d555d1c9685 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.883372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698948-d5d6-4e3c-9618-6d555d1c9685 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.883587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09698948-d5d6-4e3c-9618-6d555d1c9685 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.884989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 465/905] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:28.890577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:28.890888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:28.891165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:28.894693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 441/906] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:28 2022] POST /identity/v3/services => generated 241 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:28.898503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:28.909095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:28.910449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:28.953022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.000564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 466/907] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:29.020105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.041561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c62783-6b6f-4a3b-9dac-0363ef021e16 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.095340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.096019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.096301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.096577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.097416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:29.097744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.099173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.118629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 442/908] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:29.125340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.160837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c31bb42-4cdf-4704-801d-2221261eabe3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.172201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.207120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.207842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.208122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.208396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.209059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.210465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:29.223202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:29.224233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:29.225062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 467/909] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:29.230216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.268838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb1a36-4d23-484c-bbab-c18d688185bd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.270202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.320879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.321810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.322312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.322686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.362470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e0967-ddf8-4e8b-9ec5-895467d42d94 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.400035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.401017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.401479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.402016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.403013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:29.403602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.405193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.411569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 468/910] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:29.419789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.422000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.423735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.462208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.561772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 443/911] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:29.566233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.571708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.583124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d8ef8-2efb-4c0d-98bf-4c2c83dd8e68 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.657870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.658542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.658826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.659109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.659812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:29.660115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.661486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.667594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 469/912] 10.222.0.65 () {56 vars in 1114 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:29.672647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.713359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020be26-9e04-48e4-a601-8a04955a86ab None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.749548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:29.761110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.762057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.762441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.762817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.775799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.777358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.794892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b1f45-ffee-44c3-a75f-03babea41003 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:29.795401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:29.796544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:29.797668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:29.797668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:29.797668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:29.797668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:29.799159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 444/913] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:29.804205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:29.837844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.838904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.839345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.839817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.840702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.842504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.919554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557d7553-2b07-4402-82eb-5cb7cfebeae5 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:29.946830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 470/914] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:29.970262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:29.970854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:29.971191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:29.971471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:29.972208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:29.972515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:29.973945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:29.989060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 445/915] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:29.994680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.017830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:30.113531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb95dc-1822-4269-acca-530efa520185 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:30.151817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:30.152612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.152888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.153157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.160525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:30.162005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:30.176597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:30.177522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:30.178451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 471/916] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:30.183676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.233125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:30.301611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac08eb-0d91-4ba8-b1c4-100e21cbb7b1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:30.337293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:30.337972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.338254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.338526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.339302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:30.339661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:30.341079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd03970-2f13-42f3-9dd8-a60b3abc811a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:30.357054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 446/917] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:30.362785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.448819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:30.472162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9976e00b-085e-4f24-8838-2fa46c0d2107 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:30.514547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:30.515622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.516115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.516592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.517738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] RBAC: Adding query filter params (role.id=d757353a83334500b23c43e35b0f3359, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=4d6c4a1de21c4f1893e73c8d7f81a62e) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:30.518245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:30.519891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:30.525430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa706-5dab-4279-8ce4-009313955c69 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.525702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa706-5dab-4279-8ce4-009313955c69 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.525999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ffa706-5dab-4279-8ce4-009313955c69 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.527531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 447/918] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:30.530052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 472/919] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:30 2022] GET /identity/v3/role_assignments?user.id=4d6c4a1de21c4f1893e73c8d7f81a62e&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=d757353a83334500b23c43e35b0f3359 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:30.533609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.534268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.534776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.554068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:30.555687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:30.635024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 448/920] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:30.658630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.767856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bffd69-4db1-4f9f-b304-17d7f4176a6b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:30.804284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:30.805107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.805390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.805666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.806353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:30.807733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:30.822035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:30.823067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:30.824146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 473/921] 10.222.0.65 () {56 vars in 1132 bytes} [Fri Jun 24 15:00:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:30.832450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.858079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:30.939663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf5ab1-ff63-4d23-9fbf-3f00cfdb16ee None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:30.974199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:30.974863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:30.975146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:30.975421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:30.976125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:30.976429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:30.977818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:30.983109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 449/922] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:30.991021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:30.995389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:31.104659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29d49d-6c67-4dcc-8a28-1226ec275184 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:31.141566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:31.142281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.142560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.142831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.143547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:31.143846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:31.145210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64534c-3bf2-45f1-b742-5ddd38f55bf4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:31.151102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 474/923] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:31.157468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:31.198016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054400-290a-4633-8d28-d43f8e19da3c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.198686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054400-290a-4633-8d28-d43f8e19da3c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.199145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d054400-290a-4633-8d28-d43f8e19da3c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.201258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 475/924] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:31.208277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.208277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.208514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.226745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:31.233762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:31.284769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d11b3-3036-4b69-bb06-9b37ff10ff3a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:31.296047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:31.310081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 476/925] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:31.322967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:31.323637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.323922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.324197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.324947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:31.326366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:31.328245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:31.329432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:31.438909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1cb7-5a5d-46f3-8fff-3aa00793c318 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:31.482490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:31.483649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.484424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.484920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.486807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:31.488478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:31.494191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 450/926] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:31.514545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:31.517331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:31.519045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:31.528765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 477/927] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:31.531342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:31.699306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7e01a-3238-4181-b6ab-fcd0bd2e7e4b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:31.737568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:31.738515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.738963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.739388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.740290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:31.740732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:31.742280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:31.753211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 451/928] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:31.754739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:31.819573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:31.860375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc3b67-2bf2-40c2-bc55-735121ef5e9f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:31.896041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:31.896709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:31.896993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:31.897265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:31.897996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:31.898301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:31.899658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:31.904984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 478/929] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:31.914820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:31.918736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:32.021399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a82e2-0cbe-41e8-82f8-6b32998d6597 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.057012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.058085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.058570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.059044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.060035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] RBAC: Adding query filter params (interface=public, service_id=610f9998050345a29fbf543ec151a806, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:32.060562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:32.062755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd74cf3-9cb8-4a71-be3d-cddae8e90710 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:32.068861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 452/930] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:31 2022] GET /identity/v3/endpoints?service_id=610f9998050345a29fbf543ec151a806&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:32.074636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:32.173905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1050b3-f95e-4ce0-8239-0ceede841a69 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.174277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1050b3-f95e-4ce0-8239-0ceede841a69 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.174657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1050b3-f95e-4ce0-8239-0ceede841a69 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.176296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 453/931] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:32.180326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce0d5f-9309-456a-a92c-f84adf90c793 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.182273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.182633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.183137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.204567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:32.206222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:32.218773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.219787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.220243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.220788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.221644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:32.223242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:32.225165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:32.234220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 479/932] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:32 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:00:32.282214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:32.286340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 454/933] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:32.311011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:32.428363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1a1ff-ef07-4fa7-b739-082ad28296d8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.464066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.464758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.465036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.465311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.466054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:32.467511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:32.469857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING keystone.server.flask.common [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 15:00:32.519601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.sql.core [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 15:00:32.519601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 15:00:32.519601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [parameters: {'id': '4290ca29a07a4a12919f5fa9c89b9e9c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 15:00:32.519601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80513) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-1ea5525d-46b6-4517-bb81-796cc37d1821 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4290ca29a07a4a12919f5fa9c89b9e9c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4290ca29a07a4a12919f5fa9c89b9e9c. Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application conn.query(q) Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 15:00:32.527773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result.read() Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 24 15:00:32.528578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application next(self.gen) Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application yield resource Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application next(self.gen) Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise self.value Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application session.commit() Jun 24 15:00:32.529530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.session.flush() Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application compat.raise_( Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 15:00:32.531018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 15:00:32.531954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application conn.query(q) Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application result.read() Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 15:00:32.532803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [parameters: {'id': '4290ca29a07a4a12919f5fa9c89b9e9c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:32.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:32.536752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 4290ca29a07a4a12919f5fa9c89b9e9c. Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:32.538932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 480/934] 10.222.0.65 () {60 vars in 1140 bytes} [Fri Jun 24 15:00:32 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:32.548959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:32.651280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d763a-5ead-40af-abd4-576ab8ecd565 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.688373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.689569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.690079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.690551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.695117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fe5e-0101-4fde-a627-8ef95c52ed45 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.695400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fe5e-0101-4fde-a627-8ef95c52ed45 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.695681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8fe5e-0101-4fde-a627-8ef95c52ed45 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.698751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:32.700403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:32.704535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 481/935] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:32.705889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.706175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.706455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:32.716723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:32.717660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:32.719185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:32.725841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:32.726138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 455/936] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:32.726387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:32.728071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:32.773248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:32.800735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:32.811104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 482/937] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:32.834685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:32.859535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e543b-a4eb-43fb-bbd0-5586d6f8d954 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.904385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.905481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:32.906590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:32.907033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:32.908530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:32.909002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:32.911239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:32.933020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 456/938] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:32.957854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e0dd6-d10d-44d2-ba62-b56941644951 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:32.998720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:32.999754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.000131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.000504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.013406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:33.023110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:33.024138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:33.025062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 483/939] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:33.033202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.147323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6d5ac-3894-4ce4-8b0c-b837b9c6ac0c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:33.165906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:33.182719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:33.183389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.183673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.183951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.184692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:33.184997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:33.186393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:33.197111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 457/940] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:33.204062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.254113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:33.311528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6f369-f3d1-4100-bc45-1065e450fba1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:33.347043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:33.347836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.348109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.348380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.359634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:33.361215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:33.379598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:33.380560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:33.381474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:33.381474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:33.381474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:33.381474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:33.381474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 484/941] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:33.387875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.498202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48d7d4-bb95-4875-9a9c-3563cde663c4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:33.533854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:33.534563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.534907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.535110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.535832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:33.536132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:33.537480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:33.553715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 458/942] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:33.558971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.670119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:33.674306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19185a8-420c-4685-8fa5-a84571cd1e99 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:33.710761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:33.712014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.712495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.712967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.721881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:33.723665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a247eed1-f764-4669-bcf1-d11526ebe509 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:33.738704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:33.739691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:33.740627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:33.743504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 485/943] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:33.753535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.761586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e0e9-d5fa-48df-9a65-9272b4f08181 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.761890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e0e9-d5fa-48df-9a65-9272b4f08181 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.762172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632e0e9-d5fa-48df-9a65-9272b4f08181 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.763672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 486/944] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:33.769249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.769536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.769842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.787478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:33.788721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:33.797269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:33.861010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259871db-37fb-406f-b5a4-9fa8f671a6e6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:33.883332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 487/945] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:33.899406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:33.900341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:33.900767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:33.901197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:33.902208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:33.902677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:33.904271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:33.906189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.927242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 459/946] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:33.932951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:33.992078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.021187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e1fd0-f57b-400b-bc33-c8066afba27c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.034521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.038805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eb384e-3a49-4a8e-80db-111890d14650 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.055833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.056809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.057375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.057568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.058340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.059898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:34.073070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:34.074395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:34.075759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.077004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 488/947] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:34.088341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.088536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.088536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.088536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.088536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.098191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.099891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:34.119467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:34.120447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:34.121374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:34.121374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:34.121374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:34.121374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:34.123818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 460/948] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:34.133779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.190526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325aefeb-9493-4488-8dde-f31e14de63ea None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.239836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.240825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.241348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.241855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.242771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:34.243528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.245094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.246267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd0aca-b307-4132-a52e-062db6495895 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.251622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 489/949] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:34.263202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.275385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.286721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.290395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.290395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.290395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.290395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:34.290395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.291355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.312939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 461/950] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:34.314839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.330110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.404982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26f396-ebcb-4eb4-981d-80e012d32123 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.442712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb18d8-da74-4054-b974-7c3090c421cc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.446156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.446822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.447106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.447380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.448082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:34.448385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.449810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22d1c04-0594-4064-ae4e-9699c739f040 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.462129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 490/951] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:34.463468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e830-962a-4ee7-9b06-281151cb9b90 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.463761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e830-962a-4ee7-9b06-281151cb9b90 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.464039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46e830-962a-4ee7-9b06-281151cb9b90 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.469787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 491/952] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:34.471740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.472028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.472311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.486212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.488374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.488662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.488941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.501206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:34.502789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:34.503213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.505333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:34.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:34.527384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:34.528274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:34.531949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 462/953] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:34.548467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.587943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.601851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 492/954] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:34.620420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.647483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.684130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f03c-c585-44a8-956e-86245f58fe53 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.721541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.722258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.722540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.722814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.723602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:34.723913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.725344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.738270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 463/955] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:34.745342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.761608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da82d6a-4b6f-41b2-be3f-ec2229ea01e5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.798537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.799378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.799553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.799806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.800471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.801870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:34.814175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:34.815292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:34.816144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 493/956] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:34.821747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.866017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9d4bc-c66b-4a8e-8a2b-e4ba30fdcc8b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.894330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.899772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:34.905184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.907449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.907449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.907774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/4d6c4a1de21c4f1893e73c8d7f81a62e/roles/d757353a83334500b23c43e35b0f3359` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.910391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=4d6c4a1de21c4f1893e73c8d7f81a62e, role_id=d757353a83334500b23c43e35b0f3359)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.912030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44065106-5e42-4e90-94ea-8a580b3d7b2a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.936719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cafb4-56d2-4afb-875e-657d2cd45ede None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:34.972378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:34.973087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:34.973365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:34.973635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:34.974363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:34.974663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:34.976076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:34.981565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 494/957] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:34.987075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:34.992391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 464/958] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:34 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/4d6c4a1de21c4f1893e73c8d7f81a62e/roles/d757353a83334500b23c43e35b0f3359 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:00:35.107034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb326eb5-8995-40ae-aff4-0deb68c30bd6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:35.136922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:35.145706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:35.146412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.152692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.152692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.152692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:35.152692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:35.152692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:35.153237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc996-c64f-4e4e-841d-2e6c1fd7f5f9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.153237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc996-c64f-4e4e-841d-2e6c1fd7f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.153237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bc996-c64f-4e4e-841d-2e6c1fd7f5f9 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.153237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 465/959] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:35.156047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 495/960] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:35.157939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.158224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.158502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.161519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:35.184502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:35.185732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:35.273759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 466/961] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:35.296133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d003831-5bce-419e-ba4b-43cd316f7376 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:35.305259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:35.333280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:35.333973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.334261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.334538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.335286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:35.336658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:35.423980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1cf61-fabf-49fe-908f-88af352b440b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:35.442250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 496/962] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:35.455556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:35.478057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:35.478741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.479083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.479359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.480123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:35.481653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:35.483112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING keystone.server.flask.common [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 24 15:00:35.526372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.sql.core [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 15:00:35.526372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 15:00:35.526372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [parameters: {'user_id': 'd9c57f26a43645848d21448beb5dd7fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 15:00:35.526372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80512) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 15:00:35.544678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 15:00:35.545644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application yield resource Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application next(self.gen) Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.rollback() Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.force_reraise() Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise self.value Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application session.commit() Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 24 15:00:35.546695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._prepare_impl() Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.session.flush() Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._flush(objects) Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application compat.raise_( Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application flush_context.execute() Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rec.execute(self) Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 24 15:00:35.547774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 24 15:00:35.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result = self._query(query) Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application conn.query(q) Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application result.read() Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 24 15:00:35.549548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd9c57f26a43645848d21448beb5dd7fe', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:35.550434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 24 15:00:35.552496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:35.558736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 467/963] 10.222.0.65 () {60 vars in 1131 bytes} [Fri Jun 24 15:00:35 2022] POST /identity/v3/users => generated 160 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:35.559643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:35.623074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:35.679556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a475-044f-4911-a036-967a4d9597ac None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:35.715494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:35.716297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.716632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.716911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.725114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:35.726582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9c690622-f8cf-4967-8e95-1a55a6440a13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:35.741633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:35.744144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:35.746443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 497/964] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:35.750516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:35.857534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0c8d-9c4a-4856-855b-6513e29fb5cb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:35.893749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:35.894424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:35.894706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:35.894982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:35.895780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:35.896084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:35.897771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7adf04-16de-4674-9ca3-409d434a2277 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:35.937455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 468/965] 10.222.0.65 () {56 vars in 1101 bytes} [Fri Jun 24 15:00:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:36.589509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d005b1-d504-4f8e-98f5-10eb257202c3 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:36.590039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d005b1-d504-4f8e-98f5-10eb257202c3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:36.590039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d005b1-d504-4f8e-98f5-10eb257202c3 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:36.591512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 498/966] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:36.597310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163890-e1c8-4c04-8d0a-cbee3b18933d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:36.597595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163890-e1c8-4c04-8d0a-cbee3b18933d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:36.597908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b163890-e1c8-4c04-8d0a-cbee3b18933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:36.616169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3b163890-e1c8-4c04-8d0a-cbee3b18933d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:36.618137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3b163890-e1c8-4c04-8d0a-cbee3b18933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:36.649943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:36.688906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 469/967] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:36.711803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d005b1-d504-4f8e-98f5-10eb257202c3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:36.814916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d005b1-d504-4f8e-98f5-10eb257202c3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:36.824489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:36.849541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:36.850230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:36.850503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:36.850774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:36.851493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:36.852849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcefc57-d998-49b9-9a33-fb8d0a4a13e1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:36.945750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 499/968] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:36 2022] POST /identity/v3/services => generated 242 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:37.108736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b087-bc7a-4c31-988e-7c067cd44b18 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.109223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b087-bc7a-4c31-988e-7c067cd44b18 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.109223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5b087-bc7a-4c31-988e-7c067cd44b18 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.110720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 470/969] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:37.116271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.116560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.116841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.134611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:37.135809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:37.216022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 500/970] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:37.240359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b087-bc7a-4c31-988e-7c067cd44b18 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.344794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5b087-bc7a-4c31-988e-7c067cd44b18 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:37.380142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:37.380927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.381209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.381483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.392601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-38e7883d-58e2-45ed-a137-fecfe06efaf8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:37.401015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:37.402259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:37.403136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:37.405828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 471/971] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:37.408428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.507321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:37.513854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8639b5-553f-4c33-9763-8a0b21d06aae None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:37.549696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:37.550394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.550665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.550981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.551728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:37.552035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:37.553516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:37.555064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9e47-290e-445c-9a76-6bca37c1df07 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.555354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9e47-290e-445c-9a76-6bca37c1df07 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.555630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c9e47-290e-445c-9a76-6bca37c1df07 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.557129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 472/972] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:37.561933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.562255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.562673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.562786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 501/973] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:37.567766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.581440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:37.582691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:37.605707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:37.660638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 473/974] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:37.683710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed195be2-f9c4-4296-84c2-2017bc746781 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:37.684217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.719476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:37.720279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.720559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.720832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.734037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:37.735470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:37.753054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:37.754005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:37.754925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:37.754925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:37.754925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:37.754925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:37.754925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 502/975] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:37.760611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.772765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:37.791399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ea5be-38e1-4857-9a0e-8a0755985698 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:37.832910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:37.832910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.832910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.832910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.833337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:37.834472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:37.847292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:37.848492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:37.849699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 474/976] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:37.854444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.876198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74345-17fd-4c17-8f09-73a301de956d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:37.878117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:37.922368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:37.923522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:37.924511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:37.924935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:37.926099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:37.926581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:37.929153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:37.945700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 503/977] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:37.950125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:37.965479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e742c8cd-41d7-4da5-8d44-31253507569f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.006232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.006875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.007147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.007415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.008106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:38.008410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.009778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.015555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 475/978] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:38.020892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.023381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.060315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba1dda-aa44-44c7-a26e-ce4b885a72e1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.098932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.099749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.100023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.100289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.108221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.109661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.113192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:38.126255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:38.127474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:38.128723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 504/979] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:00:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:38.133090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.134475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6c34a-9f08-446d-89e3-34c98fd61e88 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.171140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.171944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.172299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.172652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.173288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:38.173592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.174984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.180193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 476/980] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:38.185948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.250767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f4a8d-98c0-4465-8c3c-be1724e56c1f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.280145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.288593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.289246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.294450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.294450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.294450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:38.294450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.294450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.301621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02e8c7-0987-45dc-99ec-c4664e9eeaee None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.309826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 505/981] 10.222.0.65 () {56 vars in 1149 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:38.316009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.339292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.339947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.340269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.340509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.341428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] RBAC: Adding query filter params (interface=admin, service_id=610f9998050345a29fbf543ec151a806, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:38.341886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.343284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.348998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 477/982] 10.222.0.65 () {56 vars in 1249 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/endpoints?service_id=610f9998050345a29fbf543ec151a806&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:38.354606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.369999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.422014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b92ac-cfbb-45be-b580-1ccc816337c5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.458283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.458847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.459129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.459314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f936794-a6db-411d-aeea-0768a8632896 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.459416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.501288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.502077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.502361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.502633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.503314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.504674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.521754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 478/983] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:00:38.527446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.543479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.544996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.658645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 506/984] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:38.664714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.745133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.767787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584a5a2-c37a-40dd-83dd-7ea56da0b7c0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.802813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.803598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.803876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.804144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.815256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.816684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:38.834837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:38.835778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:38.841365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:38.841365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:38.841365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:38.841365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:38.841365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 479/985] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:38.843791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:38.931820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:38.947546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a05f0d-77e8-4d9c-9b18-c2ce0fb0289c None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:38.985390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:38.986088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:38.986369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:38.986642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:38.987375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:38.987679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:38.989051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27c6f1-8101-4642-abe4-2fc4c915f2a9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.001565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 507/986] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:39.007032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.029223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38955-a42b-4cca-a324-df1b34b8977f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.029619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38955-a42b-4cca-a324-df1b34b8977f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.029952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a38955-a42b-4cca-a324-df1b34b8977f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.032539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 508/987] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:39.037421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.037702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.037995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.054738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:39.055916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:39.112716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051d06d-a772-42bc-aef5-498d8f8d5f55 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.126726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 509/988] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:39.142083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.149486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.150431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.151419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.151841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.152255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.159399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.161012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:39.175795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:39.176896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:39.178033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:39.180140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 480/989] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:39.185647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.241402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.266539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac12f1-b791-4a02-88df-baca103bd590 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.300211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9e720-8956-4a7e-b21a-2eb989e770fc None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.302495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.303394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.303649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.303929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.304584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.305979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:39.318692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:39.319782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:39.320793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 510/990] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:39.325612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.346379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.347044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.347323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.347599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.348389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:39.348696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.350275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.363250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 481/991] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:39.369066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.423144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.447352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a92e1-b1e2-4aa7-afec-20088d4824c9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.475599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e146de-1860-4f31-b8e9-05312751c54f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.488873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.489551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.489861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.490137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.490844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:39.491150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.492766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.497964 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 511/992] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:39.504171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.508749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.514424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.515080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.515358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.515629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.516454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] RBAC: Adding query filter params (role.id=d757353a83334500b23c43e35b0f3359, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=4d6c4a1de21c4f1893e73c8d7f81a62e) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:39.516864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.518348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.525082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 482/993] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/role_assignments?user.id=4d6c4a1de21c4f1893e73c8d7f81a62e&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=d757353a83334500b23c43e35b0f3359 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:39.619388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980bef3-bee8-40b2-9f4b-616eea89b9f1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.667960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.668646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.668925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.669200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.670006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:39.670313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.672379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.678725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 512/994] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:39.684505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.791082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dced2-1155-45de-bc0d-01e61928e1fa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.804330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.824956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.825891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.826078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.826315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.827100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] RBAC: Adding query filter params (interface=public, service_id=b54e487adfb145e59e38e4a7e738e4c0, region_id=RegionOne) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:39.827413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.828772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066c03d-5f4b-4a84-b974-9fe287796db9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.836650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 483/995] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/endpoints?service_id=b54e487adfb145e59e38e4a7e738e4c0&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:39.839705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:39.910571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:39.945884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346a15-494e-4b0b-923a-8403ec997568 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:39.980899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:39.981563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:39.981878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:39.982159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:39.982942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:39.984921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da084ab6-50a2-4514-a25b-e5d68f577a5d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:39.997746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 513/996] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:39 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:00:40.581251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0790c-10e6-44e2-ad3b-5f6e8bb5c2f3 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:40.581951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0790c-10e6-44e2-ad3b-5f6e8bb5c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:40.581951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae0790c-10e6-44e2-ad3b-5f6e8bb5c2f3 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:40.583316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 484/997] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:40.588428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:40.588714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:40.588990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:40.606120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:40.607309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:40.688191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 514/998] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:40.711832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0790c-10e6-44e2-ad3b-5f6e8bb5c2f3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:40.817029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae0790c-10e6-44e2-ad3b-5f6e8bb5c2f3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:40.851498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:40.852293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:40.852577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:40.852853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:40.853502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:40.854887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:40.866744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:40.868002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 24 15:00:40.868845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:40.873171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 485/999] 10.222.0.65 () {56 vars in 1126 bytes} [Fri Jun 24 15:00:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:40.874955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:40.937880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:40.977602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35fa5db-446f-484b-bcd7-9f9606f44ed3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:41.013849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:41.014612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.014894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.015171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.015877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:41.016182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:41.017753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:41.027165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 515/1000] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:41.028597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:41.073533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:41.136128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c50556-cf10-4fc8-8330-cdf6d11cac33 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:41.170085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:41.171286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.171567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.171837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.172544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:41.172842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:41.174229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e140a-e90c-4795-a1be-8bf79105085d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:41.185605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 486/1001] 10.222.0.65 () {56 vars in 1122 bytes} [Fri Jun 24 15:00:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:41.185826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:41.301713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3773a139-86e8-489a-b3aa-f5f1a119cc58 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:41.329493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:41.337861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:41.338527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.343720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.343720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.343720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:41.343720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c4964-5349-4b26-b90e-784b94cd1759 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:41.481437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 516/1002] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:41.589994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c28cf-9083-4cba-9b7c-aafd56e3e6b6 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.590517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c28cf-9083-4cba-9b7c-aafd56e3e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.590517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c28cf-9083-4cba-9b7c-aafd56e3e6b6 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.592102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 487/1003] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:41.598278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.598555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.598830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.618158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:41.619354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:41.708702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 517/1004] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:41.730900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c28cf-9083-4cba-9b7c-aafd56e3e6b6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:41.834719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c28cf-9083-4cba-9b7c-aafd56e3e6b6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:41.837033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:41.869654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:41.870470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:41.870748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:41.871018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] PATH_INFO: `/v3/services/image` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:41.871672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:41.873364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:41.885137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:41.886364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:41.887258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:41.889799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 488/1005] 10.222.0.65 () {56 vars in 1105 bytes} [Fri Jun 24 15:00:41 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:41.892757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.002601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ccff9-39a0-4bc4-8bdd-da5823bced8c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.017570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:42.038850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.039506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.039782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.040050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.040796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] RBAC: Adding query filter params (name=image) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:42.041098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.042484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8587495f-99b5-4d8b-9bf8-e3c8f2f27ca4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:42.047417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 518/1006] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:42.052895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.061799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978f45-465c-4077-a0d2-d7adbf26d392 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.062057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978f45-465c-4077-a0d2-d7adbf26d392 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.062339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8978f45-465c-4077-a0d2-d7adbf26d392 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.065193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 519/1007] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:42.069058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.069344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.069616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.087197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:42.088369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:42.160319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 520/1008] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:42.163734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b72efa-761b-4551-996c-dcdec4141376 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.183512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.198960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.199624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.199901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.200172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.200881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:42.201166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.203106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:42.211782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 489/1009] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:42.306465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cf0aa-a626-49e2-ab4d-24f255f73fe9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.315202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:42.345259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.346020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.346364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.346617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.347290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.349260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:42.362396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:42.363490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 24 15:00:42.364368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:42.366381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 521/1010] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:42.370164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.407473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:42.531138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c188427-477b-48e2-b228-18aafc703fc7 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.567492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.568155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.568435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.568706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.569410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:42.569730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.571103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:42.576296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 490/1011] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:42.581795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.699264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb44c87-60fa-4c58-9a44-fb9884ece1f7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.737588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.738346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.738635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.738932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.739623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:42.739938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.741304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ee7a3-a494-459b-ab75-b9728b27974d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:42.751376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 522/1012] 10.222.0.65 () {56 vars in 1112 bytes} [Fri Jun 24 15:00:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:42.752494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:42.851984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:42.858272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4047f-fb09-4c62-ab23-72a18ff4ea3e None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:42.893173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:42.893864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:42.894149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:42.894425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:42.895334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:42.896749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7215efdc-f788-4f8a-8dd2-e776d62627dd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:43.010154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 491/1013] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:43.549349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fda74-3193-423f-8c99-fcd0e732f168 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:43.550099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fda74-3193-423f-8c99-fcd0e732f168 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:43.550099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6fda74-3193-423f-8c99-fcd0e732f168 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:43.551447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 523/1014] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:43.556672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:43.556960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:43.557236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:43.574230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:43.575410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:43.647510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 492/1015] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:43 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:43.672083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fda74-3193-423f-8c99-fcd0e732f168 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:43.708764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:43.778402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6fda74-3193-423f-8c99-fcd0e732f168 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:43.813112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:43.813983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:43.814186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:43.814410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:43.815590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:43.817022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a1b63-1d13-4b0c-abf1-9e5ba6cb20bb None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:43.823262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 524/1016] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:43.824504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:43.905746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:43.927031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f343b0-c590-4015-94aa-1ac476b8621e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:43.966179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:43.966840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:43.967137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:43.967929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:43.968646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:43.970078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422adb9-6b1a-4f1d-b377-897dcd11ea39 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:44.089838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 493/1017] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:43 2022] POST /identity/v3/projects => generated 311 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:44.289520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990cf3-4615-497f-9d87-5da5377570ac None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:44.289916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990cf3-4615-497f-9d87-5da5377570ac None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:44.290116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d990cf3-4615-497f-9d87-5da5377570ac None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:44.291679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 525/1018] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:44.297198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36cf5-38fd-4efd-a3a1-c46378367080 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:44.297489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36cf5-38fd-4efd-a3a1-c46378367080 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:44.297790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f36cf5-38fd-4efd-a3a1-c46378367080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:44.315650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a8f36cf5-38fd-4efd-a3a1-c46378367080 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:44.317166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a8f36cf5-38fd-4efd-a3a1-c46378367080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:44.388104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 494/1019] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:44.411777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990cf3-4615-497f-9d87-5da5377570ac None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:44.517496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d990cf3-4615-497f-9d87-5da5377570ac None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:44.519174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:44.552310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:44.553086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:44.553508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:44.553832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:44.554743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:44.556518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65eefc3-22a8-4561-b055-2471355fe61e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:44.697577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 526/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:00:44 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:00:45.151729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42dc2-9cf4-4454-9ca4-ef3d32343a77 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.152247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42dc2-9cf4-4454-9ca4-ef3d32343a77 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.152247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af42dc2-9cf4-4454-9ca4-ef3d32343a77 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.153834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 495/1021] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:45.159270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.159559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.159837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.177793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:45.178972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:45.269162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 527/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:45.292854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42dc2-9cf4-4454-9ca4-ef3d32343a77 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:45.356358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:45.401821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af42dc2-9cf4-4454-9ca4-ef3d32343a77 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:45.436413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:45.437214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.438709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.438989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.449618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:45.458241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:45.459290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:45.460154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 496/1023] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:45.465342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:45.552585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:45.564895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4859ab1-48fd-44b6-9e8d-8ada1dfed35c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:45.599466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:45.600121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.600399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.600672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.601419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:45.601736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:45.603100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:45.611379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 528/1024] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:45.617010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:45.718613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34421adb-9b76-4a9a-b056-4e427659b2df None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:45.743460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:45.762265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:45.763098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.763377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.763643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.774825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:45.776340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:45.794848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:45.795821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:45.796728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:45.796728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:45.796728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:45.796728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:45.796728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 497/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:45.801774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:45.905613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde49cb2-7a52-4848-9495-289858e1039d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:45.939237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:45.939890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:45.940168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:45.940437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:45.941152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:45.941450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:45.942931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:45.955845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 529/1026] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:45.961910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.068107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a71f5-8173-49c8-96ae-06041f41aa28 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.102315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.103166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.103444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.103713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.111308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.112725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6f6d08cb-85d0-4896-be54-6f3cebe3cf6e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:46.127541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:46.128497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:46.129421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:46.133440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 498/1027] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:46.134858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.148517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.191674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc5e0-f78b-44fa-b3f0-058577a4e0ad None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.192217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc5e0-f78b-44fa-b3f0-058577a4e0ad None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.192299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc5e0-f78b-44fa-b3f0-058577a4e0ad None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.194528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 499/1028] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:46.199394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.199680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.199956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.219224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:46.223160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:46.252212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5331bb2-5eda-4053-a044-4b811c988ac1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.258194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.300781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.301459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.301753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.302049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.303045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:46.303357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.304839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.314036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 500/1029] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:46.330665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 530/1030] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:46.331982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.336114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.407826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.434568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189075f-8ed2-46f6-a526-024fc11ea0a8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.446127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d27ccd-8f89-4294-9714-31174f19c82b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.469617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.470301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.470579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.470851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.485901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.486704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.486981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.487255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.488431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.489898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.491700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 531/1031] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:46.497288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.508401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.550055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.551504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.609226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7affa9-20ab-4bed-b365-a4b8c1288300 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.650469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.651326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.651621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.651886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.652610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.654075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd22cb-4b76-4d8f-9b35-28fb9c13a578 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.665202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.673941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 501/1032] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:00:46.679964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.742535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:46.780968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 532/1033] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:00:46 2022] POST /identity/v3/users => generated 285 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:46.787494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de07068-9c70-49a4-b0b4-87e6d2e91514 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:46.811923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c8b-7ad8-4e8e-aa20-75e43436f80a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.812586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c8b-7ad8-4e8e-aa20-75e43436f80a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.812873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449c8b-7ad8-4e8e-aa20-75e43436f80a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.814580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 533/1034] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:46.820518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.820846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.821132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.828220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:46.829020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:46.829293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:46.829559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:46.839057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:46.840302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:46.842840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:46.844295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:46.863120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:46.864077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:46.864981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:46.864981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:46.864981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:46.864981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:46.864981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 502/1035] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:46.872343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.921470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 534/1036] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:46.944326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:46.995145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036a42-2d0c-44f7-97e4-f334beb27637 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.019218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.044052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.045634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.045953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.046231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.046964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.047271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.048651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.063002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 503/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:47.068427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.072453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabbdce-1a30-445b-aed2-58a9fc70a47a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.097240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.109880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.110675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.110963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.111237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.111893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.113375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:47.125635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:47.126732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:47.127767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 535/1038] 10.222.0.65 () {56 vars in 1105 bytes} [Fri Jun 24 15:00:46 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:47.133199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.198739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c214622-b6bd-4a4e-9831-d763537ab037 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.238294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.239410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.239691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.239969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.248194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.249662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.255296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47100876-8ab4-4a0e-8e7c-01f39a8fdaf1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:47.264477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:47.265609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:47.266687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 504/1039] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:47.271637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.295974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.296639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.296918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.297192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.297924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.298231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.299597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.309184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 536/1040] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:47.310192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.313350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.385523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.395090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfac065-91df-477a-b209-6c9e18deefdd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.430417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.431099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.431394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.431666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.432883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.433197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.434646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.445601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0e467-8f13-43a1-9906-f5279a8a01d6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.447278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 505/1041] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:47.453414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.487075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.487746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.488020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.488290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.488989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.489290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.490672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.496237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 537/1042] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:47.502487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.552132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.559332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70a54e8-6944-449b-9fd0-388e70bf9c63 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.595424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.596079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.596362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.596637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.597470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] RBAC: Adding query filter params (role.id=d757353a83334500b23c43e35b0f3359, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.598239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.599733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.617754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 506/1043] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=d757353a83334500b23c43e35b0f3359 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:47.617972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cdeb93-5461-4cab-b9a1-a7cd0ba658c1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.634153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:47.658277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.658997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.659338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.659677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.660652 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] RBAC: Adding query filter params (interface=public, service_id=de14b9c7166d44e0b173c0cf6f895c39, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:47.661380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.663615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd30af6-c53a-4257-a6c9-9d68f4f76fdf None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.676598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 538/1044] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/endpoints?service_id=de14b9c7166d44e0b173c0cf6f895c39&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:47.678125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:47.787875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dfcab5-9677-4e29-a799-db50c99f0b5a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:47.823208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:47.823856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:47.824135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:47.824407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:47.825083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:47.826470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f82cf-8220-44c6-883d-460ec8e4ed98 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:47.833299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 507/1045] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:00:47 2022] GET /identity/v3/services => generated 1957 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:00:48.915088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203fafc-0f29-4bc7-a421-4c53e92df904 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:48.915626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203fafc-0f29-4bc7-a421-4c53e92df904 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:48.915626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203fafc-0f29-4bc7-a421-4c53e92df904 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:48.917019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 539/1046] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:48.922582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:48.923052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:48.923154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:48.941662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:48.942918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:48.960650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:49.011888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 508/1047] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:49.035508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203fafc-0f29-4bc7-a421-4c53e92df904 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.138728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203fafc-0f29-4bc7-a421-4c53e92df904 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:49.172704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:49.173623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.173994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.174267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.185006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:49.192948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:49.194146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:49.195038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 540/1048] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:49.201968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.313089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef65de1-07f8-44cc-93bb-b5e24aa341a3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:49.354014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:49.354696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.354971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.355244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.356017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:49.356392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:49.358364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:49.372589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 509/1049] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:49.374876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.428654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:49.499797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fef20-b806-4e39-83f3-ff5c0e5736be None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:49.534025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:49.534881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.535154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.535422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] PATH_INFO: `/v3/users/c378e2b3ed124545b6b7554c8212828b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.549547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c378e2b3ed124545b6b7554c8212828b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:49.551004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69586cbe-c7ee-419b-9051-f563fd1d25b4 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:49.557465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 541/1050] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/users/c378e2b3ed124545b6b7554c8212828b => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:49.559173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.575366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:49.658244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c6b5-9bfd-4d5a-a11b-aad4a6e3818d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.658577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c6b5-9bfd-4d5a-a11b-aad4a6e3818d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.658839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd23c6b5-9bfd-4d5a-a11b-aad4a6e3818d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.660414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 542/1051] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:49.663185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e21ee4-8d41-452c-9b4e-8f96ce662899 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:49.665442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.665632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.665952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.683725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:49.684810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:49.701911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:49.702559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.702843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.703114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.769848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 543/1052] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:49.775361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:49.776834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72f8085-4fa0-456e-a2af-6eb160f70bac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:49.793098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.793787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:49.828402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:49.892585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 510/1053] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:49.894032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6008-18d1-487d-84d4-7912e2e5f0c0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.894325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6008-18d1-487d-84d4-7912e2e5f0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.894601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b6008-18d1-487d-84d4-7912e2e5f0c0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.896033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 511/1054] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:49.898282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6008-18d1-487d-84d4-7912e2e5f0c0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:49.916666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b31b6-0111-4ddc-bfe9-a1ee74a8a0a1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:49.952950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:49.953675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.953984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.954260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.964550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-63e51a79-b7af-474c-bd7e-ea51eeca11b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:49.973375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:49.974991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:49.976033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 544/1055] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:49.976733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:49.976733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:49.976733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:49.992983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:49.994207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:50.003707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b6008-18d1-487d-84d4-7912e2e5f0c0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.018351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.038711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.039802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.039918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.040101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.041287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.042756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.044467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 512/1056] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:00:49 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:50.050263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.062926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 545/1057] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:50.063636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.088684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.151343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c818c-b9a1-4ec0-93af-72210f58dd23 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.172933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283313b3-5b44-4225-a231-3aac84d07249 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.185871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.186530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.186808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.187078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.187811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.188111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.189459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.197319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 513/1058] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:50.198191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.210449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.211035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.211319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.211596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.212424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab, user.id=c378e2b3ed124545b6b7554c8212828b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.212737 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.214215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.220287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 546/1059] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/role_assignments?user.id=c378e2b3ed124545b6b7554c8212828b&scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:50.221087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.256637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.315316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.321409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a2189-20a2-4588-9771-358199b9ecc6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.336413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c0723-909b-465e-85d3-8464fab9bd39 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.358539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.359341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.359618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.359887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] PATH_INFO: `/v3/services/image` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.360540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.362103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:50.375639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:50.376701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 24 15:00:50.377562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:50.378358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.378457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 514/1060] 10.222.0.65 () {56 vars in 1105 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:50.378530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.378530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.378530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.382692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.391809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.391809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:50.410191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:50.414725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:50.415682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:50.415682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:50.415682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:50.415682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:50.415682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 547/1061] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:50.417125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.496019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbd086-b7e9-403a-a5a8-7f394261d40c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.506225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.532013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.532670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.532966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.533233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.533949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.534256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.535659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1873deb-41a6-4d07-ad86-a1d4a6482b8f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.536140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.541446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 515/1062] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:50.547916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.569180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.575392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.576893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.577333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.577797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.579091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.579091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.580625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.592300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 548/1063] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:50.597916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.659439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cdda8d-83fd-4ab7-8423-5bdf45646af0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.696123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.696784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.697057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.697326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.698078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] RBAC: Adding query filter params (type=image) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.698380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.699728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.705326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 516/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:50.710571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.713512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f87de-c8ad-4231-927f-0682354d2165 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.750004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.758290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.759659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.760084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.760366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.770383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.772596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:50.787259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:50.788241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 549/1065] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:50.794462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.823209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4069e-984f-413a-8ed6-06776b798b93 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.857787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:50.862500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.863229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.863510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.863776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.864507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.866018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.906756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64959e26-c9a6-49d4-9a74-bd24036b5c2a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:50.941262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:50.941959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:50.942240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:50.942515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:50.943354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:50.943658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:50.945110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:50.963472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 550/1066] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:50.968987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:50.975167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 517/1067] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:00:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:00:51.083203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283119a-99e4-4378-ab2f-9e1c9bc29bdf None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:51.096394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:51.132185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:51.132812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:51.133093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:51.133457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:51.144327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:51.145818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:51.164421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:51.165414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:51.166971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:51.166971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:51.166971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:51.166971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:51.166971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 551/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:51.171955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:51.282775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:51.292270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799780e4-7c6b-4a19-a8a5-cd579f180ae1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:51.330114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:51.330782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:51.331060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:51.331335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:51.332069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:51.332368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:51.337034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:51.346598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 518/1069] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:51.351964 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:51.454829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4eeaf9-9ec1-4ec2-87f4-3bbfe3cb23bd None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:51.490031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:51.490816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:51.491088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:51.491358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:51.498455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:51.499911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:51.513296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:51.514861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:51.515771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 552/1070] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:51.521848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:51.620538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e397a31-5666-45d5-af52-6eadbc38cb25 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:51.654778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:51.655437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:51.655715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:51.655980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:51.656750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:51.657052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:51.658500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23189553-0b83-4345-9764-83d0044a50d5 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:51.670983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 519/1071] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:51.676573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:51.696076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:51.780439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99d4df-9aaa-4dbf-bb59-435641d3d652 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:51.814884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:51.815770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:51.816250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:51.816743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/d757353a83334500b23c43e35b0f3359` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:51.819885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=ecc895f2eaa245dc8f1b5d811a4c88e0, role_id=d757353a83334500b23c43e35b0f3359)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:51.821575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f7414-7036-4b1d-99f7-7fe235572928 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:51.905774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 553/1072] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:51 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/ecc895f2eaa245dc8f1b5d811a4c88e0/roles/d757353a83334500b23c43e35b0f3359 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:00:52.288992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d621-bebb-4eb2-b419-959fae65bec7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:52.289477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d621-bebb-4eb2-b419-959fae65bec7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:52.289477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948d621-bebb-4eb2-b419-959fae65bec7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:52.291007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 520/1073] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:52.296639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:52.297019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:52.297197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:52.314305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:52.315517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:52.384104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 554/1074] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:52.407722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d621-bebb-4eb2-b419-959fae65bec7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:52.424092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:52.523273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948d621-bebb-4eb2-b419-959fae65bec7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:52.558628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:52.559419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:52.559756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:52.560033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:52.571284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:52.578878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:52.580071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:52.580943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:52.586059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 521/1075] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:52.589907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:52.604319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:52.710656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f247c-88dc-49cc-8346-6588709455a7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:52.748739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:52.749409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:52.749692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:52.749997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:52.750747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:52.751056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:52.752426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:52.767282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 555/1076] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:52.768696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:52.850550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:52.900401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aa2c0-943b-4db1-bb45-59c73fd5bd3a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:52.955302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:52.956180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:52.956461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:52.956731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] PATH_INFO: `/v3/users/c378e2b3ed124545b6b7554c8212828b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:52.957957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] RBAC: Authorizing `identity:get_user(user_id=c378e2b3ed124545b6b7554c8212828b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:52.959388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeef7d-671f-4153-b24c-acb154ff0988 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:52.965808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 522/1077] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:00:52 2022] GET /identity/v3/users/c378e2b3ed124545b6b7554c8212828b => generated 285 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:52.968583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:53.059448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:53.103851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74184a9b-b79e-46e6-afdb-70510bb04f87 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:53.124786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02335d5-9429-47c9-bcd9-8904a049ac23 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.125123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02335d5-9429-47c9-bcd9-8904a049ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.125350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02335d5-9429-47c9-bcd9-8904a049ac23 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.127997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 523/1078] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:53.133359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.133692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.133944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.146869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:53.147744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.149237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.149237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.150302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:53.151755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:53.153712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 556/1079] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:00:52 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:53.157510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:53.158728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:53.160010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:53.261776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 524/1080] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:53.281578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:53.285556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17fd7d-1752-4d3e-ae7f-44b610d133d1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:53.321815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:53.322704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.322986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.323261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab/users/c378e2b3ed124545b6b7554c8212828b/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.325269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a5909b34694b9a988c0e2c2bd92aab, user_id=c378e2b3ed124545b6b7554c8212828b, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:53.327418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:53.373163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:53.404012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2a161-c50a-4b13-bfd5-d23ca83f18a7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:53.422544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:53.437107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 557/1081] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:00:53 2022] PUT /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab/users/c378e2b3ed124545b6b7554c8212828b/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:00:53.441113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:53.441946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.442240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.442557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.525784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:53.527323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:53.605367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:53.639617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 525/1082] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:53.644807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:53.746688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f1955-003a-49c5-991d-12ee53c60fee None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:53.781003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:53.781898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.782186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.782463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.793191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:53.795192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4b35b837-eccb-4275-9562-5c536d7c0ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:53.812739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:53.813744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:53.814729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:53.814729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:53.814729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:53.814729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:53.814729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 558/1083] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:53.820893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:53.933477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340a8d7-4cfe-47d0-89c9-ab81b794ac98 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:53.968001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:53.968645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:53.968923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:53.969195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:53.969936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:53.970239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:53.971687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b25ed-a5ad-4e0c-9a82-16ab9f457bc4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:53.985938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 526/1084] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:54.024719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43acb-5269-4511-91a1-f2cb6418a9fa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.025078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43acb-5269-4511-91a1-f2cb6418a9fa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.025289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab43acb-5269-4511-91a1-f2cb6418a9fa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.026746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 559/1085] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:54.032539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.032900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.033084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.051773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:54.053001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:54.080670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:54.129580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 527/1086] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:00:54.152636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab43acb-5269-4511-91a1-f2cb6418a9fa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:54.210008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:54.272875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab43acb-5269-4511-91a1-f2cb6418a9fa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:54.306235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:54.307039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.307316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.307590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.318437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:54.326775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:54.328338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:54.329238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 560/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:54.333951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:54.433555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d89e1-e86e-4f3e-9c61-5f1fd41f9c90 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:54.481167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:54.481821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.482093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.482370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.483128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:54.483971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:54.485341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:54.494224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 528/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:54.500076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:54.601234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8a72ab-2304-40c8-af3b-e27e7c45a4d6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:54.612633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:54.635622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:54.636414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.636696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.636975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.647985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:54.649426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:54.668559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:54.670341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:54.671251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:54.671251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:54.671251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:54.671251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:54.671251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 561/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:54.676074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:54.700283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:54.773980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cbbe-7612-4110-ae56-09c01f09e4ef None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:54.806695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:54.807336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.807613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.807886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.808593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:54.808893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:54.810296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:54.821547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 529/1090] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:54.827559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:54.925349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a3c7-6015-4ad3-8116-223c315a8d04 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:54.959631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:54.960414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:54.960692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:54.960967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:54.968465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:54.969922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:00:54.983990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:54.985034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 24 15:00:54.986060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:54.989939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 562/1091] 10.222.0.65 () {56 vars in 1093 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:54.990974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.073128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.091299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddcb3ef-a40f-44c9-a596-dbb995445e89 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.125684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.126420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.126701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.126978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.127815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:55.128124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.129544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.146997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 530/1092] 10.222.0.65 () {56 vars in 1133 bytes} [Fri Jun 24 15:00:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:55.152790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.177447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.256106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f79f53-f510-496f-93c3-76e11000cf4d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.297224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.297902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.298181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.298456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.368063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.369513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa85d1c-07fe-43b4-a7c6-7fe03e9a20e9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.393980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.484105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 563/1093] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:00:55.489906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.499331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dae98-b7c1-4c1e-83f7-6abf5992ad55 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.500059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dae98-b7c1-4c1e-83f7-6abf5992ad55 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.500341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26dae98-b7c1-4c1e-83f7-6abf5992ad55 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.501742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 564/1094] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:00:55.506654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.506941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.507224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.524010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:55.525203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:55.590873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b53bd-6606-470d-8c52-b92ebf67685d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.597255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 565/1095] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:55.621850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.625139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.625954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.626231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.626498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.634628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.636726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.638215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:00:55.655387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:55.656533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:55.657932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:00:55.657932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:00:55.657932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:00:55.657932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:55.657932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 531/1096] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:00:55.662267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.678674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.724216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78664a13-8d4a-4ba0-b7eb-8125a569f640 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.759838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.760617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.760893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.761165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.761276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c3b22-6d28-46c2-87c9-986665ac100f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.771078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:00:55.778511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:55.779658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:00:55.780822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 566/1097] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:55.785702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.794929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.795664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.795951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.796229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.796947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:55.797255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.798656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.809793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 532/1098] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:55.815889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.870897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.891819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4020935-bacf-486b-957c-609da8667b02 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.905766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:55.926305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.926969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.927243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.927515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.928325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:55.928637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.930414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.930543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e1c0-27d5-48f3-97de-bd4e7ac2854f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:55.939536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 567/1099] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:55.945378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:55.963840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:55.964627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:55.964906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:55.965179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:55.972711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:55.974169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:00:55.988806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:00:55.989962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:00:55.990928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 533/1100] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:00:55.996498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:56.045515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c68c6-c43d-4108-9865-e49537f653d8 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.080174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.081041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.081322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.081598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] PATH_INFO: `/v3/users/c378e2b3ed124545b6b7554c8212828b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.082838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] RBAC: Authorizing `identity:get_user(user_id=c378e2b3ed124545b6b7554c8212828b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.084258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.085939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 568/1101] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/users/c378e2b3ed124545b6b7554c8212828b => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:56.092240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:56.098683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5751ba-da8d-49aa-a1f2-bbd253aaa066 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.112457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:56.134172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.134701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:56.134906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.135350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.135635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.136420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:56.136732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.138254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.150821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 534/1102] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:00:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:56.158774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:56.191768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bae3ce-f1a5-495d-a36d-d35bd6710578 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.226958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.227807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.228129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.228407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.262513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8cffc-d690-4555-b41a-44fa6d38eec1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.296429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.296726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.297371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.297649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.297900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.298006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.298754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] RBAC: Adding query filter params (role.id=d757353a83334500b23c43e35b0f3359, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=ecc895f2eaa245dc8f1b5d811a4c88e0) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:56.299061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.300472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.306494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 535/1103] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:56 2022] GET /identity/v3/role_assignments?user.id=ecc895f2eaa245dc8f1b5d811a4c88e0&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=d757353a83334500b23c43e35b0f3359 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:00:56.342767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:56.406975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 569/1104] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:00:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 24 15:00:56.412956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:56.449597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:56.516587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45952c72-09da-41a6-b408-c27e8f4e928d None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.551254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.552109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.552384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.552658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.553888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.555317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee287f-6b64-4105-94f9-4ae823d5cd13 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.557020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 536/1105] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:00:56 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:56.563265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:56.665450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d427493c-18e8-4f5a-aa22-8bf07756183f None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:56.701917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:56.702581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:56.702859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:56.703135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:56.703964 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab, user.id=c378e2b3ed124545b6b7554c8212828b) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:00:56.704279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:56.705802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eaca31-1097-43c4-9925-17e1d347bf5c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:56.711988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 570/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:00:56 2022] GET /identity/v3/role_assignments?user.id=c378e2b3ed124545b6b7554c8212828b&scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:58.784177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071894-bc30-4e80-bed0-2c81a2ca7d4c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:58.784752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071894-bc30-4e80-bed0-2c81a2ca7d4c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:58.784752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4071894-bc30-4e80-bed0-2c81a2ca7d4c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:58.786107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 537/1107] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:00:58.791259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:58.791666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:58.791812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:58.802743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:58.808377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:00:58.809563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:00:58.874981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 571/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:00:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:00:58.900368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071894-bc30-4e80-bed0-2c81a2ca7d4c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:58.999783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4071894-bc30-4e80-bed0-2c81a2ca7d4c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:59.002057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:59.033539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:59.034389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:59.034621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:59.034895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:59.036059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:59.037492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b6854-0fdf-4564-888f-f74e6e4445d2 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:59.039130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 538/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:00:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:00:59.044838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:00:59.140948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64232c26-f31d-4ec7-881a-a31d714131bd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:00:59.173080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:00:59.173754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:00:59.174042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:00:59.174313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:00:59.175018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:00:59.176442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd13d6-4fff-484b-9e50-91b56908cb4a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:00:59.183817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:00:59.284214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 572/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:00:59 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:01.379339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec16e-3ff0-4e4a-8e51-c4f45d033840 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:01.379866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec16e-3ff0-4e4a-8e51-c4f45d033840 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:01.379866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ec16e-3ff0-4e4a-8e51-c4f45d033840 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:01.381246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 539/1111] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:01.386828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:01.387358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:01.387358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:01.404644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:01.405891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:01.472048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 573/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:01.495578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ec16e-3ff0-4e4a-8e51-c4f45d033840 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:01.600911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ec16e-3ff0-4e4a-8e51-c4f45d033840 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:01.633844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:01.634670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:01.634946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:01.635216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] PATH_INFO: `/v3/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:01.636656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] RBAC: Authorizing `identity:get_role(role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:01.638046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:01.639394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 540/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:01 2022] GET /identity/v3/roles/6e961f1500a848fe9f3cc181f375ddda => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:01.645351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:01.740508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaeefb9-1416-4a6b-b6af-d7266f2111cc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:01.763438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:01.774552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808813-d559-43b2-becc-539564d431e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:01.775411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808813-d559-43b2-becc-539564d431e3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:01.775694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808813-d559-43b2-becc-539564d431e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:01.775971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30808813-d559-43b2-becc-539564d431e3 None admin] PATH_INFO: `/v3/users/dfc7be5f1d61447a885bf57e412457d7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:01.788738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808813-d559-43b2-becc-539564d431e3 None admin] RBAC: Authorizing `identity:get_user(user_id=dfc7be5f1d61447a885bf57e412457d7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:01.790208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30808813-d559-43b2-becc-539564d431e3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:01.791856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 574/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:01 2022] GET /identity/v3/users/dfc7be5f1d61447a885bf57e412457d7 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:01.802068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:01.852190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:01.908456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eb0f78-de50-4f51-8255-0bb364ac2a04 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:01.941408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:01.942064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:01.942350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:01.942629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:02.013047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:02.014575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:02.053635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:02.110596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 541/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:02.116765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808813-d559-43b2-becc-539564d431e3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:02.216258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30808813-d559-43b2-becc-539564d431e3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:02.250142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:02.250989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:02.251259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:02.251528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:02.252688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:02.254144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af48c8f-8ba1-4907-9e52-590a4e7d8e43 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:02.255852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 575/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:02 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:02.262060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:02.357835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695080ef-8600-4a9b-bb2b-f103335450e0 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:02.390708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:02.391350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:02.391630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:02.391904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:02.392726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab, user.id=dfc7be5f1d61447a885bf57e412457d7) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:02.393034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:02.394487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb904f-1c2d-48a7-b6c0-d466cc986383 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:02.399811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 542/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:02 2022] GET /identity/v3/role_assignments?user.id=dfc7be5f1d61447a885bf57e412457d7&scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:04.417025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f9ee-2571-4cba-a1d3-cfe73ddc780c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:04.417587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f9ee-2571-4cba-a1d3-cfe73ddc780c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:04.417587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833f9ee-2571-4cba-a1d3-cfe73ddc780c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:04.418951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 576/1118] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:04.424461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:04.424880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:04.425009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:04.431007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:04.441998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:04.443186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:04.508376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 543/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:04.531413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f9ee-2571-4cba-a1d3-cfe73ddc780c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:04.581541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:04.632307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833f9ee-2571-4cba-a1d3-cfe73ddc780c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:04.667006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:04.667852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:04.668132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:04.668405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] PATH_INFO: `/v3/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:04.669930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] RBAC: Authorizing `identity:get_role(role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:04.671295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:04.672696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 577/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:04 2022] GET /identity/v3/roles/6e961f1500a848fe9f3cc181f375ddda => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:04.678635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:04.775230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c05f8c-6a7c-4432-857d-797a3c265e14 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:04.808497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:04.809368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:04.809647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:04.809948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] PATH_INFO: `/v3/users/dfc7be5f1d61447a885bf57e412457d7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:04.811121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] RBAC: Authorizing `identity:get_user(user_id=dfc7be5f1d61447a885bf57e412457d7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:04.812552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:04.814213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 544/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:04 2022] GET /identity/v3/users/dfc7be5f1d61447a885bf57e412457d7 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:04.820315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:04.918560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754833a3-1b63-475b-a8aa-63095248e1e0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:04.937138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:04.955246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:04.956094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:04.956433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:04.956701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:04.957961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:04.959378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234db6de-cbf4-487c-87c5-c6eb55d29c6c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:04.961074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 578/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:04 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:04.967117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:04.969967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:05.067109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75a080-a97b-4f15-9f64-32b99b3ab08a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:05.100162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:05.101033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:05.101314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:05.101586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab/users/dfc7be5f1d61447a885bf57e412457d7/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:05.103785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e1a5909b34694b9a988c0e2c2bd92aab, user_id=dfc7be5f1d61447a885bf57e412457d7, role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:05.105212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55673e-6a18-467c-a077-6976976782d1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:05.163101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 545/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:01:04 2022] PUT /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab/users/dfc7be5f1d61447a885bf57e412457d7/roles/6e961f1500a848fe9f3cc181f375ddda => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:01:07.175560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e25b6-f79d-481b-9157-a96256669730 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:07.176098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e25b6-f79d-481b-9157-a96256669730 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:07.176098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e25b6-f79d-481b-9157-a96256669730 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:07.177488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 579/1124] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:07.182639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:07.183021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:07.183184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:07.199513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:07.200678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:07.256167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:07.266189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 546/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:07.290603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e25b6-f79d-481b-9157-a96256669730 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:07.389477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e25b6-f79d-481b-9157-a96256669730 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:07.423344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:07.424188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:07.424462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:07.424736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] PATH_INFO: `/v3/roles/6e961f1500a848fe9f3cc181f375ddda` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:07.426293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] RBAC: Authorizing `identity:get_role(role_id=6e961f1500a848fe9f3cc181f375ddda)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:07.427608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:07.428993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 580/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:07 2022] GET /identity/v3/roles/6e961f1500a848fe9f3cc181f375ddda => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:07.434896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:07.530167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b81dc-aecb-4867-81e9-c0d82e2eac91 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:07.562541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:07.563422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:07.563701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:07.563978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] PATH_INFO: `/v3/users/dfc7be5f1d61447a885bf57e412457d7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:07.565145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=dfc7be5f1d61447a885bf57e412457d7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:07.566592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:07.568214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 547/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:07 2022] GET /identity/v3/users/dfc7be5f1d61447a885bf57e412457d7 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:07.574095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:07.625882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:07.671456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ccf1-d02a-4bd6-aa74-2bb3034dff91 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:07.704073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:07.704635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:07.704910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:07.705178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:07.769999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:07.771445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:07.819407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:07.866397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 581/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:07.872296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:07.929941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:07.968973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097feb5-e928-4e51-9d7c-e49ce3046eb3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:08.002342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:08.003191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:08.003469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:08.003738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] PATH_INFO: `/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:08.004901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] RBAC: Authorizing `identity:get_project(project_id=e1a5909b34694b9a988c0e2c2bd92aab)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:08.006354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e1e1-7d2d-49f5-a769-b9bcf58761de None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:08.008040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 548/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:07 2022] GET /identity/v3/projects/e1a5909b34694b9a988c0e2c2bd92aab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:08.014780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:08.114528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1130a9-8908-435a-8f6e-6fbed3016e7d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:08.148771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:08.149413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:08.149690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:08.149993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:08.150815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] RBAC: Adding query filter params (role.id=6e961f1500a848fe9f3cc181f375ddda, scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab, user.id=dfc7be5f1d61447a885bf57e412457d7) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:08.151120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:08.152543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08610065-e2c5-4248-abf2-ba279d3c3492 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:08.158273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 582/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:08 2022] GET /identity/v3/role_assignments?user.id=dfc7be5f1d61447a885bf57e412457d7&scope.project.id=e1a5909b34694b9a988c0e2c2bd92aab&role.id=6e961f1500a848fe9f3cc181f375ddda => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:10.211051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332354e7-62cf-4083-95ee-be1f35cca8d0 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:10.211565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332354e7-62cf-4083-95ee-be1f35cca8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:10.211657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332354e7-62cf-4083-95ee-be1f35cca8d0 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:10.212968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 549/1131] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:10.218274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:10.218668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:10.218829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:10.235838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:10.236931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:10.248223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:10.302439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 583/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:10.327074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332354e7-62cf-4083-95ee-be1f35cca8d0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:10.425865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332354e7-62cf-4083-95ee-be1f35cca8d0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:10.452499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:10.460159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:10.460939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:10.461264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:10.461488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:10.462676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:10.464102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb871e-9809-4892-b586-95e99f13123f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:10.465842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 550/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:01:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:10.471688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:10.568272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784b420-08fd-491f-921a-b62dc9eb1248 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:10.601259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:10.601943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:10.602227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:10.602504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:10.603201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:10.604634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6312209b-0f67-4ac6-96f5-91f49a853c99 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:10.726999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:10.734773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 584/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:01:10 2022] POST /identity/v3/projects => generated 311 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:12.781805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917619ab-501f-450d-9d09-e78d6e4b14cb None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:12.782362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917619ab-501f-450d-9d09-e78d6e4b14cb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:12.782362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917619ab-501f-450d-9d09-e78d6e4b14cb None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:12.783731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 551/1135] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:12.789090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:12.789512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:12.789628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:12.806655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:12.807849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:12.873122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 585/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:12.898069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917619ab-501f-450d-9d09-e78d6e4b14cb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:12.995579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917619ab-501f-450d-9d09-e78d6e4b14cb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:13.029568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:13.030392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:13.030671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:13.030948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:13.032168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:13.033530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400522e7-4469-4bbf-b398-592d1880c371 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:13.035177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 552/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:01:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:13.040923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:13.135522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fd5a7-c307-4346-8c06-cd3e6aecd628 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:13.161135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:13.168465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:13.169119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:13.169398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:13.169742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:13.172225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:13.172225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062d849-0e05-4538-8403-41c8a28c4220 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:13.254655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 586/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:01:13 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:15.332297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84b84-91e2-4057-a07f-738e788df85a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:15.332883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84b84-91e2-4057-a07f-738e788df85a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:15.332883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda84b84-91e2-4057-a07f-738e788df85a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:15.334246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 553/1139] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:15.339500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:15.339946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:15.340044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:15.357205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:15.358422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:15.426579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 587/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:15.450435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84b84-91e2-4057-a07f-738e788df85a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:15.511591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:15.549559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda84b84-91e2-4057-a07f-738e788df85a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:15.581609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:15.582412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:15.582688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:15.582961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:15.593245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:15.600678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:15.601929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:15.603244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 554/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:15.608627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:15.724808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989bd38-566a-4e8d-b831-a8e285619c84 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:15.739574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:15.758376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:15.759033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:15.759308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:15.759575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:15.760305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:15.760598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:15.762024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:15.769601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 588/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:15.775438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:15.873000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f3b0a0-e261-42ac-8d66-9ceab30ba537 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:15.895734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:15.906639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:15.911727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:15.911727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:15.911727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] PATH_INFO: `/v3/users/04e4161f4b054187856b53405e0c31a0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:15.920813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] RBAC: Authorizing `identity:get_user(user_id=04e4161f4b054187856b53405e0c31a0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:15.922271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:15.923915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 555/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:15 2022] GET /identity/v3/users/04e4161f4b054187856b53405e0c31a0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:15.929653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:16.036908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4791181-06b1-4e46-bb3e-191a9cfe1af9 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:16.068657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:16.069295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:16.069571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:16.069873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:16.114163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:16.137303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:16.138771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:16.232996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 589/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:16.238812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:16.336022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caef57-68e3-473f-ac90-8f2022722a36 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:16.368258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:16.369096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:16.369377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:16.369651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] PATH_INFO: `/v3/projects/66805f84aefe49a09b77955cbf9044a7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:16.370866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] RBAC: Authorizing `identity:get_project(project_id=66805f84aefe49a09b77955cbf9044a7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:16.372811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12464ad-8cea-4e5f-b491-b234ec685908 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:16.374545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 556/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:16 2022] GET /identity/v3/projects/66805f84aefe49a09b77955cbf9044a7 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:16.380686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:16.455514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:16.477182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623909-f7a5-4b4d-8704-68cedf8c2046 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:16.510793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:16.511441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:16.512576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:16.512854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:16.513674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=66805f84aefe49a09b77955cbf9044a7, user.id=04e4161f4b054187856b53405e0c31a0) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:16.514015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:16.515448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c7a7e-acec-4165-be19-27f9ad045236 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:16.520896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 590/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:16 2022] GET /identity/v3/role_assignments?user.id=04e4161f4b054187856b53405e0c31a0&scope.project.id=66805f84aefe49a09b77955cbf9044a7&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:18.556950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a5dc-420a-45a6-a4aa-54c86c51bd9f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:18.557465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a5dc-420a-45a6-a4aa-54c86c51bd9f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:18.557465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a5dc-420a-45a6-a4aa-54c86c51bd9f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:18.558825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 557/1147] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:18.563961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:18.564384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:18.564509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:18.580821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:18.582036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:18.646540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 591/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:18.670359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91a5dc-420a-45a6-a4aa-54c86c51bd9f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:18.720360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:18.770344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91a5dc-420a-45a6-a4aa-54c86c51bd9f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:18.806127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:18.806895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:18.807226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:18.807450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:18.817361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:18.825400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:18.826536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:18.827465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 558/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:18.832745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:18.900487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:18.930182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb45dbe-a5ec-4461-b9c9-d99197f9b94e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:18.962901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:18.963549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:18.963829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:18.964104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:18.965418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:18.965702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:18.967092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:18.975106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 592/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:18.980885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:19.077051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b4f27-d001-4a1f-8ba4-d20f06dbb8a3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:19.086898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:19.109575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:19.110497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:19.110775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:19.111051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] PATH_INFO: `/v3/users/04e4161f4b054187856b53405e0c31a0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:19.112234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] RBAC: Authorizing `identity:get_user(user_id=04e4161f4b054187856b53405e0c31a0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:19.113649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:19.115574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 559/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:18 2022] GET /identity/v3/users/04e4161f4b054187856b53405e0c31a0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:19.121297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:19.219948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde16cbd-19e9-49a7-851c-7c5a2547041d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:19.248676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:19.253390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:19.254268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:19.254545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:19.254816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] PATH_INFO: `/v3/projects/66805f84aefe49a09b77955cbf9044a7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:19.255965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] RBAC: Authorizing `identity:get_project(project_id=66805f84aefe49a09b77955cbf9044a7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:19.257400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1aceb-7333-494d-a5f2-8c4a1a37ca9c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:19.259149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 593/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:19 2022] GET /identity/v3/projects/66805f84aefe49a09b77955cbf9044a7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:19.265741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:19.366914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a2c50-b649-47f9-bd57-9e4c81a573bf None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:19.401318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:19.402240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:19.402522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:19.402796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] PATH_INFO: `/v3/projects/66805f84aefe49a09b77955cbf9044a7/users/04e4161f4b054187856b53405e0c31a0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:19.404784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] RBAC: Authorizing `identity:create_grant(project_id=66805f84aefe49a09b77955cbf9044a7, user_id=04e4161f4b054187856b53405e0c31a0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:19.406258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2898a0-5558-4f0b-9f41-d7df91491dbf None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:19.494292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 560/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:01:19 2022] PUT /identity/v3/projects/66805f84aefe49a09b77955cbf9044a7/users/04e4161f4b054187856b53405e0c31a0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:01:21.500980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb532-16e6-44e2-bd19-c09e96461b4b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:21.501499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb532-16e6-44e2-bd19-c09e96461b4b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:21.501499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3bb532-16e6-44e2-bd19-c09e96461b4b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:21.502853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 594/1154] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:21.507970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:21.508356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:21.508523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:21.525211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:21.526430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:21.555811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:21.592230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 561/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:21.616831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb532-16e6-44e2-bd19-c09e96461b4b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:21.714673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3bb532-16e6-44e2-bd19-c09e96461b4b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:21.747987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:21.748771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:21.749049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:21.749320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:21.759636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:21.767532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:21.768464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:01:21.769308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 595/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:21.774753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:21.869646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215b7eb-64c6-48b6-a4e8-05c90e73f2f6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:21.902907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:21.903564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:21.903844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:21.904123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:21.904862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:21.905173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:21.906563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:21.914458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 562/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:21.920626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:21.976349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:22.015106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a1de9-4207-4da1-b60b-756693e9bee3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:22.047754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:22.048605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:22.048878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:22.049145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] PATH_INFO: `/v3/users/04e4161f4b054187856b53405e0c31a0` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:22.050325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] RBAC: Authorizing `identity:get_user(user_id=04e4161f4b054187856b53405e0c31a0)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:22.051743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:22.053351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 596/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:21 2022] GET /identity/v3/users/04e4161f4b054187856b53405e0c31a0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:22.059713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:22.089668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:22.157697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453a074-6655-4088-b146-c6f62c6c93a1 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:22.203079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:22.203726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:22.204011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:22.204288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:22.273595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:22.274997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:22.303581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:22.371701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 563/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:22.377554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:22.475769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0653a8-4b6f-4208-9fd9-006ac2208a90 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:22.502017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:22.509529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:22.510411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:22.510694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:22.510967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] PATH_INFO: `/v3/projects/66805f84aefe49a09b77955cbf9044a7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:22.512655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] RBAC: Authorizing `identity:get_project(project_id=66805f84aefe49a09b77955cbf9044a7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:22.514112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08872332-037f-4373-853b-a5a4e2b4e2a5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:22.515815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 597/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:22 2022] GET /identity/v3/projects/66805f84aefe49a09b77955cbf9044a7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:22.522016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:22.621575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eba229-e459-4b7f-930f-1693e4479480 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:22.649436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:22.655478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:22.656124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:22.656405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:22.656680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:22.657502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=66805f84aefe49a09b77955cbf9044a7, user.id=04e4161f4b054187856b53405e0c31a0) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:22.657839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:22.665292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f91e5e-6f27-42e5-9b12-e384861c7694 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:22.665292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 564/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:22 2022] GET /identity/v3/role_assignments?user.id=04e4161f4b054187856b53405e0c31a0&scope.project.id=66805f84aefe49a09b77955cbf9044a7&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:24.704094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8559b9e-c553-44d0-a633-d22b263c9c3b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:24.704619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8559b9e-c553-44d0-a633-d22b263c9c3b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:24.704619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8559b9e-c553-44d0-a633-d22b263c9c3b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:24.706060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 598/1162] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:24.711239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:24.711636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:24.711793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:24.728938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:24.729850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:24.795074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 565/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:24.817711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8559b9e-c553-44d0-a633-d22b263c9c3b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:24.915564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8559b9e-c553-44d0-a633-d22b263c9c3b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:24.947415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:24.948038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:24.948316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:24.948584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:25.007161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:25.014031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:25.015483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:25.115286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 599/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:25.121559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:25.221736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652be174-1b7d-4ee4-8975-35570ef5a318 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:25.244776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:25.255481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:25.256267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:25.256550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:25.256825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:25.264171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:25.265543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-54eb14e9-d157-4311-be0c-1c07b212db67 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:25.280662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:25.281947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:25.283014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 566/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:01:25 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:25.287920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:25.381180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:25.389628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c4ac4-8c83-42ae-8951-5d0bcbe08388 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:25.424170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:25.424830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:25.425112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:25.425385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:25.426135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:25.426445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:25.427804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a284a-e2d6-4bcf-81ec-1661e1354622 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:25.435501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 600/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Fri Jun 24 15:01:25 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:27.456964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6833d4-543e-4b25-8b18-1aa94976426f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:27.457518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6833d4-543e-4b25-8b18-1aa94976426f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:27.457518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6833d4-543e-4b25-8b18-1aa94976426f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:27.458914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 567/1167] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:27.464115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d407d-3fff-4327-8796-e8986ecf7027 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:27.464559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d407d-3fff-4327-8796-e8986ecf7027 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:27.464652 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d407d-3fff-4327-8796-e8986ecf7027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:27.486180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1a7d407d-3fff-4327-8796-e8986ecf7027 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:27.487306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1a7d407d-3fff-4327-8796-e8986ecf7027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:27.553152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 601/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:27.576254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6833d4-543e-4b25-8b18-1aa94976426f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:27.677816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6833d4-543e-4b25-8b18-1aa94976426f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:27.710173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:27.710817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:27.711097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:27.711368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:27.712103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:27.713454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b583b1b-615e-4c52-92de-6ece2e078be9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:27.796008 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 568/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Fri Jun 24 15:01:27 2022] POST /identity/v3/domains => generated 267 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:29.841250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9033e6-7ad7-4360-bdcf-70abeb80e885 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:29.841902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9033e6-7ad7-4360-bdcf-70abeb80e885 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:29.841902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9033e6-7ad7-4360-bdcf-70abeb80e885 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:29.843208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 602/1170] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:29.848370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:29.848796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:29.848902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:29.865594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:29.866905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:29.907590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:29.932783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 569/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:29.957038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9033e6-7ad7-4360-bdcf-70abeb80e885 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:30.045347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:30.055608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9033e6-7ad7-4360-bdcf-70abeb80e885 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:30.088892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:30.089789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:30.090073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:30.090347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] PATH_INFO: `/v3/domains/c5f4fe330d184788805ab16bd01c8219` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:30.100409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c5f4fe330d184788805ab16bd01c8219)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:30.101881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83863bd8-bafe-4115-94cf-a9a1bc894017 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:30.103507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 603/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Fri Jun 24 15:01:29 2022] GET /identity/v3/domains/c5f4fe330d184788805ab16bd01c8219 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:30.110264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:30.206331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e417ae3-43fc-4418-9005-02196673aa5a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:30.241325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:30.242019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:30.242300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:30.242573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:30.243267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:30.244693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cc847-f132-47a8-9d65-55b6888d5edb None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:30.373018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 570/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:01:30 2022] POST /identity/v3/projects => generated 361 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:32.460042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145e51-a307-4b63-9d24-8614e8ae0f12 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:32.460590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145e51-a307-4b63-9d24-8614e8ae0f12 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:32.460590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02145e51-a307-4b63-9d24-8614e8ae0f12 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:32.461987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 604/1174] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:32.467177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:32.467616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:32.467712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:32.484892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:32.486052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:32.506828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:32.551892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 571/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:01:32.577632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02145e51-a307-4b63-9d24-8614e8ae0f12 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:32.676505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02145e51-a307-4b63-9d24-8614e8ae0f12 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:32.709646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:32.710531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:32.710813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:32.711090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] PATH_INFO: `/v3/domains/c5f4fe330d184788805ab16bd01c8219` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:32.712270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c5f4fe330d184788805ab16bd01c8219)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:32.713696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49932e64-9b23-443e-9976-eedd388c6f53 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:32.715383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 605/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Fri Jun 24 15:01:32 2022] GET /identity/v3/domains/c5f4fe330d184788805ab16bd01c8219 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:32.721264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:32.830530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b0fa8-2aea-412a-adb3-197f859f42de None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:32.862634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:32.863287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:32.863567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:32.863840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:32.864813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:32.866262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df1774-0811-43db-955d-7014fc42b015 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:32.993521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 572/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:01:32 2022] POST /identity/v3/users => generated 311 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:01:35.066176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e5d6-d9e3-4e25-be0b-7bc8d4dfca22 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.066706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e5d6-d9e3-4e25-be0b-7bc8d4dfca22 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.066706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e5d6-d9e3-4e25-be0b-7bc8d4dfca22 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.068068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 606/1178] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:35.073175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329418-66dd-4962-9724-9850b3c50169 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.073625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329418-66dd-4962-9724-9850b3c50169 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.073764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329418-66dd-4962-9724-9850b3c50169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.090631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-11329418-66dd-4962-9724-9850b3c50169 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:35.091810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-11329418-66dd-4962-9724-9850b3c50169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:35.099012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:35.158878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 573/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:35.182936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e5d6-d9e3-4e25-be0b-7bc8d4dfca22 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:35.202052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:35.284997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e5d6-d9e3-4e25-be0b-7bc8d4dfca22 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:35.317938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:35.318640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.318919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.319180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.330025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:35.337528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:35.338594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:01:35.339545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 607/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:35.344914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329418-66dd-4962-9724-9850b3c50169 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:35.442021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329418-66dd-4962-9724-9850b3c50169 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:35.474690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:35.475338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.475618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.475889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.476626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:35.477402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:35.478315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:35.486783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 574/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:35.492784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:35.569120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:35.589399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9dc194-af9a-4e70-a25d-ca17433f5cf5 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:35.623139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:35.623997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.624270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.624537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] PATH_INFO: `/v3/users/dce3e1c1468641f59b2927ab3f034ea7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.637276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] RBAC: Authorizing `identity:get_user(user_id=dce3e1c1468641f59b2927ab3f034ea7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:35.638723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:35.640386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 608/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:35 2022] GET /identity/v3/users/dce3e1c1468641f59b2927ab3f034ea7 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:35.646231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:35.649951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:35.742878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f964d-4b91-4a80-a6a1-989cd38cc555 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:35.774600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:35.775229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:35.775508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:35.775779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:35.852235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:35.853672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:35.856866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:35.949644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 575/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:35.955532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:36.050836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26222c3b-42e3-4f50-91bc-bdb764541297 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:36.082786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:36.083624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:36.083896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:36.084164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] PATH_INFO: `/v3/projects/57ae10e350be47b2919c9682554a6201` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:36.085305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] RBAC: Authorizing `identity:get_project(project_id=57ae10e350be47b2919c9682554a6201)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:36.086753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d71693-3af5-48b2-b272-ee0fa79e08af None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:36.088425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 609/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:35 2022] GET /identity/v3/projects/57ae10e350be47b2919c9682554a6201 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:36.095115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:36.191694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58025f88-8271-4bd9-9c93-56677a26a07b None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:36.193939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:36.225215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:36.226167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:36.226448 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:36.226724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:36.227549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=57ae10e350be47b2919c9682554a6201, user.id=dce3e1c1468641f59b2927ab3f034ea7) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:36.227852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:36.229286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658bb98-142b-4d54-8d23-8c4651b939c9 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:36.234787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 576/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:36 2022] GET /identity/v3/role_assignments?user.id=dce3e1c1468641f59b2927ab3f034ea7&scope.project.id=57ae10e350be47b2919c9682554a6201&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:38.224916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f312d-6580-4105-934b-a38e1f3ceb19 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.224916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f312d-6580-4105-934b-a38e1f3ceb19 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.224916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f312d-6580-4105-934b-a38e1f3ceb19 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.226319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 610/1186] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:38.231589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.232011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.232126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.249362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:38.250591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:38.314537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 577/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:38.336678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f312d-6580-4105-934b-a38e1f3ceb19 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:38.340432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:38.449309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f312d-6580-4105-934b-a38e1f3ceb19 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:38.481782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:38.482511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.482792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.483067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.493647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:38.501683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:38.502736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:01:38.503645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 611/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:38.509131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:38.601688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:38.605995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb1d5-b848-44a0-89c3-88a04e3d8365 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:38.639038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:38.639687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.639964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.640235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.640988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:38.641284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:38.642654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:38.650635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 578/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:38.656939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:38.716570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:38.753611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f356fb-40ed-43e4-befb-0d2b62ff70e1 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:38.786109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:38.786951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.787236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.787503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] PATH_INFO: `/v3/users/dce3e1c1468641f59b2927ab3f034ea7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.788655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] RBAC: Authorizing `identity:get_user(user_id=dce3e1c1468641f59b2927ab3f034ea7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:38.790101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:38.791715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 612/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:38 2022] GET /identity/v3/users/dce3e1c1468641f59b2927ab3f034ea7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:38.798084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:38.894277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3539d58-49a4-4aab-b378-69ac5d6f7704 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:38.926922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:38.927758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:38.928038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:38.928312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] PATH_INFO: `/v3/projects/57ae10e350be47b2919c9682554a6201` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:38.929472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] RBAC: Authorizing `identity:get_project(project_id=57ae10e350be47b2919c9682554a6201)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:38.930919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a0cc79-efd0-4900-8df9-9e68693d08ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:38.932600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 579/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:38 2022] GET /identity/v3/projects/57ae10e350be47b2919c9682554a6201 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:38.938506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:39.034976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6185350-149c-4479-8c94-d5348e6235af None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:39.063025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:39.068099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:39.068980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:39.069261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:39.069536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] PATH_INFO: `/v3/projects/57ae10e350be47b2919c9682554a6201/users/dce3e1c1468641f59b2927ab3f034ea7/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:39.071503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] RBAC: Authorizing `identity:create_grant(project_id=57ae10e350be47b2919c9682554a6201, user_id=dce3e1c1468641f59b2927ab3f034ea7, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:39.072928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934966-22de-4bbd-b657-e3c105a37d99 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:39.159204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 613/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:01:38 2022] PUT /identity/v3/projects/57ae10e350be47b2919c9682554a6201/users/dce3e1c1468641f59b2927ab3f034ea7/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:01:41.150533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b787-0619-4a64-b189-86aa30353a83 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.151062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b787-0619-4a64-b189-86aa30353a83 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.151062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b5b787-0619-4a64-b189-86aa30353a83 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.152474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 580/1193] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:01:41.157578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.158032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.158159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.175527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:01:41.176710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:01:41.245842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 614/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:01:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:01:41.270100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5b787-0619-4a64-b189-86aa30353a83 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:41.298621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:41.374039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b5b787-0619-4a64-b189-86aa30353a83 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:41.408034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:41.408735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.409016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.409288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.420152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:01:41.427689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:01:41.428867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:01:41.429952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 581/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:01:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:01:41.435664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:41.532977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c54ed6-32d7-427d-9c6d-56b5ffc41da5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:41.554812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:41.565963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:41.569491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:41.577967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 615/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:01:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:41.583815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:41.674029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:41.685921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f143bd-86ea-44fd-a115-07a29c65bbfb None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:41.719296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:41.720144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.720423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.720696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] PATH_INFO: `/v3/users/dce3e1c1468641f59b2927ab3f034ea7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.721912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] RBAC: Authorizing `identity:get_user(user_id=dce3e1c1468641f59b2927ab3f034ea7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:41.723334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:41.725184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 582/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Fri Jun 24 15:01:41 2022] GET /identity/v3/users/dce3e1c1468641f59b2927ab3f034ea7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:41.730727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:41.825281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002ed63b-60e9-4364-ab75-3341c0cb0157 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:41.856755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:41.857393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:41.857675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:41.857987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:41.909000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:41.923548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:41.928156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:42.020478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 616/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:01:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:01:42.026440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:42.123820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d4f762-7c2d-401e-87ae-9ad558c2e0aa None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:42.156219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:42.157066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:42.157349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:42.157621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] PATH_INFO: `/v3/projects/57ae10e350be47b2919c9682554a6201` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:42.158822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] RBAC: Authorizing `identity:get_project(project_id=57ae10e350be47b2919c9682554a6201)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:42.160234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d059fe-de95-409d-8c35-aa13e86598fd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:42.161946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 583/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Fri Jun 24 15:01:42 2022] GET /identity/v3/projects/57ae10e350be47b2919c9682554a6201 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:42.168460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:01:42.250181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:42.264993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4de2b-2837-48fb-abef-f6ed12c6b06a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:01:42.298094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:01:42.298728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:01:42.299011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:01:42.299285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:01:42.300102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=57ae10e350be47b2919c9682554a6201, user.id=dce3e1c1468641f59b2927ab3f034ea7) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:01:42.300409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:01:42.301852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a55b3b-a2b8-4fe6-ac76-ef1957802697 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:01:42.307528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 617/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:01:42 2022] GET /identity/v3/role_assignments?user.id=dce3e1c1468641f59b2927ab3f034ea7&scope.project.id=57ae10e350be47b2919c9682554a6201&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:01:52.151971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:01:52.304944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=26 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:02:57.253561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101d5f-27ff-4308-9fa0-87c99cf676dd None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:02:57.254189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101d5f-27ff-4308-9fa0-87c99cf676dd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:02:57.254189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101d5f-27ff-4308-9fa0-87c99cf676dd None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:02:57.255494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 584/1201] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:02:57.260627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:02:57.261072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:02:57.261170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:02:57.277919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:02:57.279100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:02:57.347083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 618/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:02:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:02:57.372219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101d5f-27ff-4308-9fa0-87c99cf676dd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:02:57.477157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101d5f-27ff-4308-9fa0-87c99cf676dd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:02:57.511337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:02:57.512154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:02:57.512431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:02:57.512703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:02:57.522505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:02:57.523979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:02:57.541671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:02:57.542726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:02:57.543729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:02:57.543729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:02:57.543729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:02:57.543729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:02:57.543729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 585/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:02:57.549682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:02:57.646763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a86465-300a-4f20-ada5-79d6eaed8ec1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:02:57.675250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:02:57.680900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:02:57.681762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:02:57.681936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:02:57.682211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:02:57.683106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:02:57.683416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:02:57.684823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017a54c-02b0-48d2-92fa-c42b3dce719c None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:02:57.696787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 619/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:02:57.702570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:02:57.756203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:02:57.800539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc037-6ef9-4d04-bdcc-7c6848602dad None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:02:57.834083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:02:57.834739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:02:57.835020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:02:57.835300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:02:57.836007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:02:57.837426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c1796b-1978-42f3-9065-c9df099dc02f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:02:57.953497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 586/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Fri Jun 24 15:02:57 2022] POST /identity/v3/users => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:03:00.039668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b48b-6844-4e59-8345-042c3ad3e64e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.040218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b48b-6844-4e59-8345-042c3ad3e64e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.040218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7b48b-6844-4e59-8345-042c3ad3e64e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.041615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 620/1206] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:00.047637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.053747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.053747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.065329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:00.066566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:00.132304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 587/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:00.155799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b48b-6844-4e59-8345-042c3ad3e64e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:00.263789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7b48b-6844-4e59-8345-042c3ad3e64e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:00.296922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:00.297633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.297938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.298208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.308335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:00.316290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:00.317489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:00.318878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 621/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:00.323595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:00.363186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:00.421574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebea6c0-2196-448d-b2c7-9eed5930afa5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:00.453954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:00.454617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.454894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.455164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.455897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:00.456199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:00.457598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:00.465404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 588/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:00.471656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:00.527037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:00.575698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3395b6-4b32-448d-b058-a57d7ce8e02d None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:00.609610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:00.610419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.610702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.610976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.620844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:00.622326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:00.639195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:00.640243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:00.641390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:00.641390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:00.641390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:00.641390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:00.641390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 622/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:00.646311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:00.746323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:00.749418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fcefc-6b38-4370-9f7a-c20113ca9090 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:00.783305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a704723-9589-4de5-acea-715415d9370c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:00.783980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a704723-9589-4de5-acea-715415d9370c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.784385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a704723-9589-4de5-acea-715415d9370c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.784638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a704723-9589-4de5-acea-715415d9370c None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.785358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a704723-9589-4de5-acea-715415d9370c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:00.785664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a704723-9589-4de5-acea-715415d9370c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:00.787052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a704723-9589-4de5-acea-715415d9370c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:00.798069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 589/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:00.809201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:00.903121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc782d55-27ea-4c3c-9dd2-6985afc5ab01 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:00.905213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:00.937247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:00.938062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:00.938340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:00.938610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:00.945509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:00.947041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:00.961585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:00.965021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:00.966857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 623/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:00.969330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a704723-9589-4de5-acea-715415d9370c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:01.068154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a704723-9589-4de5-acea-715415d9370c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:01.101320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:01.102003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:01.102282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:01.102593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:01.103413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:01.103713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:01.105109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:01.122970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 590/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:01.128713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:01.229515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4f79e9-20a7-44f1-b331-c75047c2c852 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:01.264897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:01.265544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:01.265898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:01.266187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:01.296211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:01.336909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:01.338412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:01.436748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 624/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:03:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:03:01.442661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:01.461781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:01.546430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c08e50-c8fe-43ad-8d8e-2f6083c250c4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:01.580957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:01.581820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:01.582053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:01.582325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:01.592392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:01.593861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:01.611657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:01.617225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:01.618387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:01.618387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:01.618387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:01.618387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:01.618387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 591/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:01.618775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:01.678632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:01.715585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce758a09-b08a-4b60-adb5-31554f188463 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:01.750710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:01.751365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:01.751698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:01.751975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:01.752687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:01.752992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:01.754376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:01.765615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 625/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:03:01.771508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:01.858593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:01.891490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3436fa03-310f-4997-a431-3c7a7acfe014 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:01.926203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:01.926979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:01.927253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:01.927522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:01.933936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:01.935379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:01.948392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:01.949598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:01.950851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 592/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:01.955699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:02.055725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e253620-a8c9-4451-9eb3-156e15915264 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:02.077559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:02.088723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:02.089370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:02.089672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:02.089976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:02.090744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:02.091046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:02.092961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bbe868-9490-4f2e-938e-12ac53de14b5 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:02.104690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 626/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:02.115520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:02.210372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1572f-b23b-440d-b213-713b9831b35f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:02.239826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:02.245320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:02.246012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:02.246284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:02.246569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:02.247424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=2d090a2340be4b6cbe533c22fbdf9057) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:02.247735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:02.249158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef43fc-4924-47ab-8a11-568e4ddb46ac None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:02.254552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 593/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:03:02 2022] GET /identity/v3/role_assignments?user.id=2d090a2340be4b6cbe533c22fbdf9057&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:04.281883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253866-fe81-41bb-83b3-2a341b868c83 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:04.282476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253866-fe81-41bb-83b3-2a341b868c83 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:04.282476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93253866-fe81-41bb-83b3-2a341b868c83 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:04.287722 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 627/1220] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:04.289652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:04.290126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:04.290222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:04.307969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:04.309163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:04.379457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 594/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:04.402972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253866-fe81-41bb-83b3-2a341b868c83 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:04.510149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93253866-fe81-41bb-83b3-2a341b868c83 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:04.548045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:04.548834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:04.549119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:04.549398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:04.559486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:04.567172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:04.573433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:04.580561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 628/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:03:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:04.581451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:04.673714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a87ee-e4e1-4c3b-853b-3bbef5e2e35b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:04.696645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:04.711744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:04.712412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:04.712693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:04.712964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:04.713709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:04.714045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:04.715405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:04.724053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 595/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:03:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:04.730247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:04.774963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:04.834395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01762aa-149b-4362-9950-af64fe5ca3a3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:04.865960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:04.866728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:04.867003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:04.867271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:04.878268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:04.879693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:04.896630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:04.897710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:04.898867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:04.898867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:04.898867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:04.898867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:04.898867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 629/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:04.903631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.002112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305459b-3771-4e29-b03b-76381f5b2ea6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.035443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.036032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.036308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.036577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.037288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:05.037587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.038969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.050776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 596/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:05.056615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.150689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:05.157277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68027c10-b5df-4387-b86c-7d98ad3ce2bf None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.190113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.190910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.191188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.191458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.198881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.200396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:05.214223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:05.215362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:05.216422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 630/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:05.221336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.268077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:05.320841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31705c-b05a-486e-9452-6fd3f91d7fa4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.358440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.359110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.359395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.359670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.360882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:05.361187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.362650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.380846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 597/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:03:05.386811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.489331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8cdd7-9f91-4ce1-be3c-2e4574c89766 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.522077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.522859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.523137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.523409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.534295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.535731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:05.553407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:05.554546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:05.555774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:05.555774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:05.555774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:05.555774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:05.555774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 631/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:05.560462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.657793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf927e8-daa7-4f6c-95fa-02e21926b1f6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.660217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:05.690782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.691427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.691702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.691967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.692669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:05.692964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.694337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.705048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 598/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:05.710734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.720792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:05.810164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb171df-f38d-43a3-98b9-47be1c2e20e3 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:05.857096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:05.858688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:05.858962 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:05.859233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:05.865936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:05.867370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:05.881312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:05.885944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:05.887240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 632/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:05.888390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:05.988079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e60b7-dd54-437d-8c07-af54305978a4 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:06.021665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:06.022352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:06.022633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:06.022906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:06.023684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:06.023990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:06.025415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0f817-eddf-4dfb-98d4-7ce8592ab97f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:06.037922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 599/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:06.043865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:06.109664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:06.144578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb92c8-7424-48ec-ba01-842d4d18d964 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:06.184984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:06.186024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:06.186310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:06.186589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/2d090a2340be4b6cbe533c22fbdf9057/roles/66abc2bf33ab48d1afcb8b2395f2db3b` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:06.202414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=2d090a2340be4b6cbe533c22fbdf9057, role_id=66abc2bf33ab48d1afcb8b2395f2db3b)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:06.203940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23f362d-9a68-4d9b-b6f8-6d278e336502 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:06.307158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 633/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:03:06 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/2d090a2340be4b6cbe533c22fbdf9057/roles/66abc2bf33ab48d1afcb8b2395f2db3b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:03:08.335675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d9b2-bf5e-4969-bd38-3eca892f72ba None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:08.336198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d9b2-bf5e-4969-bd38-3eca892f72ba None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:08.336198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66d9b2-bf5e-4969-bd38-3eca892f72ba None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:08.337593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 600/1233] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:08.342857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:08.343318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:08.343453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:08.360248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:08.361420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:08.429288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 634/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 24 15:03:08.453292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66d9b2-bf5e-4969-bd38-3eca892f72ba None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:08.477662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:08.554650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66d9b2-bf5e-4969-bd38-3eca892f72ba None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:08.590728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:08.592293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:08.592660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:08.593642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:08.604295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:08.612977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:08.614158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:08.615223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 601/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Fri Jun 24 15:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:08.620514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:08.667643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:08.720899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cd09a-a6b4-497a-a7fa-027b5514295e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:08.754185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:08.754777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:08.755056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:08.755331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:08.756070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:08.756380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:08.757790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:08.766222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 635/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Fri Jun 24 15:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:08.772104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:08.855007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:08.871003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbcc92-9997-462a-8135-f70f6b00cfe6 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:08.904444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:08.905229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:08.905508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:08.905808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:08.919128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:08.922254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:08.941328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:08.942475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:08.943821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:08.943821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:08.943821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:08.943821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:08.943821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 602/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 24 15:03:08.948345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:09.049073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b25adba-0718-4dea-8e99-a9c1045798ab None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:09.059029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:09.084050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:09.084706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:09.084989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:09.085265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:09.086030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:09.086337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:09.091019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:09.099660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 636/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:09.105255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:09.203941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00456e0-6da2-46f3-87b8-a2d73022eb67 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:09.238519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:09.239326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:09.239639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:09.239945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:09.242715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:09.247268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:09.249193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:09.264042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:09.265783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:09.266918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 603/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:09.271728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:09.369143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf05a4d-7daf-47b0-ac00-0ecfbf958bca None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:09.409550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:09.410242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:09.410525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:09.410795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:09.411624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:09.411928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:09.413346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:09.431278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 637/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:09.437506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:09.538441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eacec-e392-40f2-acad-8a62e9b5f2bd None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:09.572496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:09.573155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:09.573489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:09.573823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:09.636545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:09.643517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:09.644981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:09.744284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 604/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:03:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:03:09.750693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:09.777430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:09.847459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e140d-fba5-40ba-a856-af55c19fef6b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:09.881324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:09.882134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:09.882413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:09.882684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:09.892670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:09.894075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:09.911209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:09.912312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:09.913424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:09.913424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:09.913424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:09.913424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:09.913424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 638/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:09.918246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:10.012984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:10.018865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7070717a-4366-4a0c-82a8-ec7650a7593f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:10.053313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:10.054766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:10.054766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:10.054766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:10.055275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:10.055577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:10.056935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:10.067995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 605/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:10.073693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:10.150214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:10.171994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c54a62-854f-4198-a60a-7b5b510e4e1b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:10.204812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:10.205609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:10.205922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:10.206206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:10.212943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:10.214421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:10.228747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:10.229790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:10.230788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 639/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:10.236812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:10.335450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fa489-7364-40f5-8aaa-5a0e307d41e3 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:10.369342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:10.370034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:10.370318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:10.370594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:10.371372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:10.371679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:10.373134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9f28e-3174-47dd-8628-a9f6a7c3d347 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:10.385761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 606/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:10.392279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:10.490459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030e7b77-197b-4d75-ba0e-7fbc9838dfa0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:10.522605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:10.523245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:10.523544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:10.523814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:10.524629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] RBAC: Adding query filter params (role.id=66abc2bf33ab48d1afcb8b2395f2db3b, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=2d090a2340be4b6cbe533c22fbdf9057) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:10.524933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:10.526381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa45b38-3751-4a75-8d78-7dfd72c82eec None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:10.533145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 640/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:03:10 2022] GET /identity/v3/role_assignments?user.id=2d090a2340be4b6cbe533c22fbdf9057&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=66abc2bf33ab48d1afcb8b2395f2db3b => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:12.634942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec46dd-4d01-42b4-a15a-cc288b039d35 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:12.635509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec46dd-4d01-42b4-a15a-cc288b039d35 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:12.635509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec46dd-4d01-42b4-a15a-cc288b039d35 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:12.636861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 607/1247] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:12.642925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:12.643322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:12.643581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:12.648499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:12.660472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:12.661662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:12.727051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 641/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:12.752612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec46dd-4d01-42b4-a15a-cc288b039d35 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:12.770730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:12.852437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec46dd-4d01-42b4-a15a-cc288b039d35 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:12.887288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:12.887997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:12.888274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:12.888543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:12.898720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:12.906239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:12.909750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:12.910693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 608/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:03:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:12.913922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.012046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf405708-54be-464c-a5f4-1d8be4068695 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.041411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:13.046890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.047497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.047773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.048044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.048784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:13.049091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.050478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:13.058502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 642/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:13.064325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.141041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:13.163561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1c374-0a5f-43dc-ab14-83fdb5aca641 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.196180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.197082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.197293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.197566 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.208429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.209866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:13.227155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:13.228208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:13.229306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:13.229306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:13.229306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:13.229306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:13.229306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 609/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:13.235042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.331728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac93e3-a69b-4fe6-8f9f-67d5e9c757b7 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.364559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.365206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.365484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.365785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.366495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:13.366792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.368137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:13.379956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 643/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:13.385634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.500869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6e10c-90ba-4030-a4e3-c3ef3de5393a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.526695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:13.535139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.535931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.536219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.536492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.543920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.545390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:13.559396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:13.560578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:13.562019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 610/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:13.566452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.621907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:13.665076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2eee4-1fe6-466b-a224-cd0cb8056c5b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.698034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.698891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.699177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.699449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.700268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:13.700569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.702533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:13.720481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 644/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:13.726460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:13.827398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da41468-7a30-4a5b-878f-abdb340bd766 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:13.860925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68f05-a893-4103-921b-be834023455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:13.861602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68f05-a893-4103-921b-be834023455a None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:13.862043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68f05-a893-4103-921b-be834023455a None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:13.862324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc68f05-a893-4103-921b-be834023455a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:13.918797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:13.930423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc68f05-a893-4103-921b-be834023455a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:13.931854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc68f05-a893-4103-921b-be834023455a None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.028335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 611/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:03:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:03:14.034272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:14.133740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab703ea-4d83-47cd-b4be-5c658162895e None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:14.148583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:14.169024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:14.169855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:14.170140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:14.170931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:14.180932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:14.182421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:14.200167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:14.201285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:14.202460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:14.202460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:14.202460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:14.202460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:14.202460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 645/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:14.207290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68f05-a893-4103-921b-be834023455a None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:14.296723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:14.307990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc68f05-a893-4103-921b-be834023455a None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:14.341465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:14.342147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:14.342424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:14.342694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:14.343409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:14.343706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:14.345144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.356821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 612/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:14.363467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:14.461610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337507a1-4192-47cc-8b3e-ec9b7119650a None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:14.496001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:14.496785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:14.497062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:14.497330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:14.504828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:14.506293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:14.519928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:14.521169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:14.522152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 646/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:14.527436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:14.631059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c287a8-d9e6-4211-9f11-e7de7d37f899 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:14.665278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:14.665960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:14.666239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:14.666509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:14.667294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:14.667595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:14.669025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650f8fed-b533-438f-8970-b1fb7f953954 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.681927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 613/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:14.688176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:14.714793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:14.790728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e710f7-1738-4fa7-9f1d-becdd115fb90 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:14.825953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:14.826601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:14.826879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:14.827153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:14.828072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=2d090a2340be4b6cbe533c22fbdf9057) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:14.828366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:14.829829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84928a6-4130-450d-a009-33aa555c3e66 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:14.835188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 647/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:03:14 2022] GET /identity/v3/role_assignments?user.id=2d090a2340be4b6cbe533c22fbdf9057&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:16.829374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f03c-5d3b-4ad7-8043-37aafaaaf9d3 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:16.830028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f03c-5d3b-4ad7-8043-37aafaaaf9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:16.830028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687f03c-5d3b-4ad7-8043-37aafaaaf9d3 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:16.831294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 614/1261] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:16.836402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:16.836990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:16.836990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:16.853397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:16.859521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:16.921080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 648/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:16.944051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687f03c-5d3b-4ad7-8043-37aafaaaf9d3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:16.955471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.062035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687f03c-5d3b-4ad7-8043-37aafaaaf9d3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.095637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.096293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.096623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.096853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.107013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:17.115558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:17.116782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:17.117913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 615/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:17.122897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:17.142082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.220678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea9ae4-e5a4-401e-bc21-364c6e05d84a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.254920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.255584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.255867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.256145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.256889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:17.257195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:17.258581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:17.267151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 649/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:03:17.272858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:17.340535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.374420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a6987-9845-43f5-b184-e877dfc1b372 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.409242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.410207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.410810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.411088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.422262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:17.423687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:17.445243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:17.446404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:17.447357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:17.447357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:17.447357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:17.447357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:17.447357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 616/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:17.456138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:17.537684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.556644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a886a4-cff3-4ae2-a12d-1dfd318380ac None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.588277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.588934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.589215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.589491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.590294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:17.590578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:17.591948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:17.603932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 650/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:17.610602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:17.712326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24115e20-326f-429c-adbc-01e88b846189 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.731733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.745257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.746080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.746348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.746614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.755244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:17.760258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:17.771189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:17.772389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:17.773769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 617/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:17.778283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:17.876994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9401b5-9f6b-49c0-bb8c-fa67520b3c6b None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:17.910567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:17.911241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:17.911521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:17.911796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:17.912626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:17.912934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:17.914390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:17.923065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:17.931394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 651/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:17.937185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:18.038473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec3e5e-4deb-4d5f-a4af-af06e25cc78f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:18.073315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:18.074115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:18.074393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:18.074659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:18.085562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:18.087011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:18.103902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:18.105017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:18.106211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:18.106211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:18.106211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:18.106211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:18.106211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 618/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:18.111134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:18.209872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c15c4-bb53-4c52-a1f5-9978c8017436 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:18.244956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:18.245595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:18.245997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:18.246270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:18.246975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:18.247295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:18.249185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:18.261268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 652/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:18.267611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:18.300434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:18.370281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d3ad0-e9d9-44bf-a3cf-9b92688c115f None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:18.405015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:18.405923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:18.406140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:18.406414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:18.413186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:18.414664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:18.428133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:18.429272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:18.435165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 619/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:18.435803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:18.493955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:18.535330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09291769-ed9c-4f4d-be1b-6f5751cf1623 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:18.568230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:18.568766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:18.569042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:18.569314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:18.570128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:18.570432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:18.571860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e0905-d4b1-4b87-ae1e-54d4e5124091 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:18.584560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 653/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:18.590620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:18.688492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:18.697041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e4313-3313-4464-9e8e-a34c66734960 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:18.730611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:18.731492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:18.731767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:18.732039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] PATH_INFO: `/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/2d090a2340be4b6cbe533c22fbdf9057/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:18.734842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] RBAC: Authorizing `identity:create_grant(project_id=33717ea7e4ab4344bb085f272c78c674, user_id=2d090a2340be4b6cbe533c22fbdf9057, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:18.736263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3383c2ca-024b-4a25-8529-6f0266e26f8b None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:18.906597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 620/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Fri Jun 24 15:03:18 2022] PUT /identity/v3/projects/33717ea7e4ab4344bb085f272c78c674/users/2d090a2340be4b6cbe533c22fbdf9057/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:03:20.939333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e12a-5bc5-4bc4-b1d9-2b05bd4870c5 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:20.939861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e12a-5bc5-4bc4-b1d9-2b05bd4870c5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:20.939861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4e12a-5bc5-4bc4-b1d9-2b05bd4870c5 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:20.941259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 654/1274] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:20.946838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:20.947283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:20.947379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:20.963732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:20.964908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:21.032258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 621/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:21.056449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e12a-5bc5-4bc4-b1d9-2b05bd4870c5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.157691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4e12a-5bc5-4bc4-b1d9-2b05bd4870c5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:21.175096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:21.191655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226900be-d352-4599-931c-7059e6e08add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:21.192372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226900be-d352-4599-931c-7059e6e08add None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:21.192647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226900be-d352-4599-931c-7059e6e08add None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:21.192916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226900be-d352-4599-931c-7059e6e08add None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:21.203835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226900be-d352-4599-931c-7059e6e08add None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-226900be-d352-4599-931c-7059e6e08add None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 24 15:03:21.211475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:21.213091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:21.214227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 655/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:21.221873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.315666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:21.333655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0688b-5c4c-4646-8e18-346123b79742 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:21.368727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:21.369421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:21.369701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:21.370010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:21.370758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:21.371066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:21.372439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:21.381093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 622/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:21.386992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226900be-d352-4599-931c-7059e6e08add None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.499794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226900be-d352-4599-931c-7059e6e08add None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:21.534185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:21.534977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:21.535251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:21.535527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:21.546547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:21.550392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:21.565394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:21.566543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:21.567487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:21.567487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:21.567487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:21.567487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:21.567487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 656/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:21.572517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.677325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec9f8f-b93d-48fb-87bd-18dc1fe87b7c None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:21.710790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:21.711447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:21.711728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:21.712005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:21.712728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:21.713035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:21.714426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:21.726120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 623/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:03:21.732359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.764022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:21.832676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c27c61-f6be-40aa-a8c9-09a0ead3fe88 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:21.866511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:21.867310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:21.867593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:21.867872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:21.876031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:21.877477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 24 15:03:21.891350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:21.892488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:21.893501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 657/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:21.898620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:21.902361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.001830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6094e05e-48a9-4214-ac3e-35460cfb6f67 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.035064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.035672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.035954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.036230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.037053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:22.037359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.038838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:22.056672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 624/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Fri Jun 24 15:03:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:22.062566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:22.153945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.163658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1364dc-8415-484d-9ac7-ba0fbe9ab1b6 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.196162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.196805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.197090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.197361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.263131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.264615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:22.352655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.363617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 658/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Fri Jun 24 15:03:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 24 15:03:22.369462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:22.434731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.474480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a5c37-609d-4578-88ba-62c158d9eb18 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.507217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.508007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.508289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.508562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.520486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.522023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 24 15:03:22.539717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:22.540938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:22.542258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 24 15:03:22.542258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 24 15:03:22.542258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 24 15:03:22.542258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:22.542258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 625/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:22.546807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:22.644167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a377-4ff4-4353-bcb3-177ee8d9fa13 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.677868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.678529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.678816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.679092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.679810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:22.680115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.681479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:22.692595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 659/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Fri Jun 24 15:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:22.698277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:22.797538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c04ba5-5130-4a43-8bad-20ead06a9d49 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.811411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.831267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.832049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.832332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.832606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.839240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.840676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 24 15:03:22.854635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:22.855543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: ERROR keystone.server.flask.application Jun 24 15:03:22.856593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 626/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Fri Jun 24 15:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:22.861999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:22.912251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:22.959956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ba865-a062-4b9d-b583-ae79b0dd6f78 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:22.993308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:22.993997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:22.994281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:22.994564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:22.995346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:22.995762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:22.997179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b153f-094e-4fdd-abe3-a9824201eb1f None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:23.009313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 660/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Fri Jun 24 15:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:23.015576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:23.118424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6da74e-b68b-4183-a04b-805dad3842ee None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:23.152994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:23.153638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:23.153951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:23.154226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:23.155701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] RBAC: Adding query filter params (role.id=13f9d35b508b4da8b84fcc1c1d7bd324, scope.project.id=33717ea7e4ab4344bb085f272c78c674, user.id=2d090a2340be4b6cbe533c22fbdf9057) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:23.161878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:23.161878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551870b8-83e9-4ad5-ac80-0541f83d1292 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:23.163271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 627/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Fri Jun 24 15:03:23 2022] GET /identity/v3/role_assignments?user.id=2d090a2340be4b6cbe533c22fbdf9057&scope.project.id=33717ea7e4ab4344bb085f272c78c674&role.id=13f9d35b508b4da8b84fcc1c1d7bd324 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:25.201137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307dc7-34dc-46e5-a160-6e80e5acf221 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:25.202223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307dc7-34dc-46e5-a160-6e80e5acf221 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:25.202333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa307dc7-34dc-46e5-a160-6e80e5acf221 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:25.203644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 661/1288] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:25.208764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:25.209187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:25.209306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:25.225531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:25.226735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:25.256159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:25.293273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 628/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:25.316511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307dc7-34dc-46e5-a160-6e80e5acf221 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:25.418979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa307dc7-34dc-46e5-a160-6e80e5acf221 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:25.430489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:25.453795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:25.454507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:25.458085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:25.458085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:25.458085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:25.458085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:25.468857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:25.470094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:25.471172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 662/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:03:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:25.476142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:25.578499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30602e-1a58-4df1-a0c7-9052ccac7382 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:25.613048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:25.613712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:25.614024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:25.614296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:25.614992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:25.615293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:25.616664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7796c7-c03f-4d22-8923-c5f2d5df2be6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:25.621405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 629/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Fri Jun 24 15:03:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:25.627812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:25.728455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85968-3857-465b-8dfe-0c77882264e0 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:25.762370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:25.763030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:25.763313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:25.763619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] PATH_INFO: `/v3/services` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:25.764314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:25.764617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:25.766004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d14aff-625f-450a-b1c3-146a9470f2d6 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:25.770361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 663/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Fri Jun 24 15:03:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:27.806531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705fc-de6b-42f8-811f-7989cc6f4d58 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:27.807231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705fc-de6b-42f8-811f-7989cc6f4d58 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:27.807231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64705fc-de6b-42f8-811f-7989cc6f4d58 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:27.808579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 630/1293] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:27.815404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729281e2-ed51-424d-9033-f62e50a8b36e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:27.815937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729281e2-ed51-424d-9033-f62e50a8b36e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:27.815937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729281e2-ed51-424d-9033-f62e50a8b36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:27.835107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-729281e2-ed51-424d-9033-f62e50a8b36e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:27.836344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-729281e2-ed51-424d-9033-f62e50a8b36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:27.867884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:27.905567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 664/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:27.928589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64705fc-de6b-42f8-811f-7989cc6f4d58 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:27.959452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:28.027563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64705fc-de6b-42f8-811f-7989cc6f4d58 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:28.063026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:28.063616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:28.063895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:28.064168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:28.064881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:28.066312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285423bc-a231-46f4-8737-95b2a1dac42d None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:28.146476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 631/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Fri Jun 24 15:03:27 2022] POST /identity/v3/services => generated 246 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:03:30.199008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bddf9-5099-47b0-9712-fc3daa0e9a22 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.199598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bddf9-5099-47b0-9712-fc3daa0e9a22 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.199598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bddf9-5099-47b0-9712-fc3daa0e9a22 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.200951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 665/1296] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:30.206540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.206946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.207088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.223601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:30.224947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:30.297905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 632/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:30.320979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bddf9-5099-47b0-9712-fc3daa0e9a22 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:30.425442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bddf9-5099-47b0-9712-fc3daa0e9a22 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:30.459235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:30.459989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.460267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.460539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.461198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:30.462590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:30.474784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:30.476690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:30.477616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 666/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:03:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:30.482871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:30.500689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:30.579124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204349dd-2d50-4349-bdf6-b6fce465463c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:30.614508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:30.615161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.615438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.615710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.616399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:30.616697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:30.618103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:30.623233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 633/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Fri Jun 24 15:03:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:30.629217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:30.662366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:30.730940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e8fa5-b9af-4dc9-9e2b-95701d1edb37 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:30.765274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:30.765952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.766235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.766581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.767371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] RBAC: Adding query filter params (interface=public, service_id=153a21e8f51b4c6f8428e2ade944a1bc, region_id=RegionOne) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:30.767683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:30.769052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2283-c907-4a1c-b54e-c7b82d97ef0a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:30.774337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 667/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Fri Jun 24 15:03:30 2022] GET /identity/v3/endpoints?service_id=153a21e8f51b4c6f8428e2ade944a1bc&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:30.780552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:30.860401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:30.880071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d2113-e52f-4d07-aaab-bfc625eef571 None admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:30.913397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:30.914127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:30.914406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:30.914681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:30.915363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:30.916714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e27843-02f9-4bac-8bec-f31e481d7108 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:30.923501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 634/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Fri Jun 24 15:03:30 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:03:32.969302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114011e8-cd9d-4373-8f42-ce6c786e2be6 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:32.969873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114011e8-cd9d-4373-8f42-ce6c786e2be6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:32.969873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114011e8-cd9d-4373-8f42-ce6c786e2be6 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:32.971272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 668/1302] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:03:32.976578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:32.977000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:32.977125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:32.994615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:03:32.995997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:03:33.066917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 635/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:03:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 24 15:03:33.093046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114011e8-cd9d-4373-8f42-ce6c786e2be6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:33.188259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:33.194710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114011e8-cd9d-4373-8f42-ce6c786e2be6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:33.228158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:33.228951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:33.229221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:33.229488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:33.230165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:33.231779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 24 15:03:33.243204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 24 15:03:33.244203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.get_or_create( Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application with Lock( Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self._enter() Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application return self.creator() Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application created_value = creator( Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: ERROR keystone.server.flask.application Jun 24 15:03:33.245085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 669/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Fri Jun 24 15:03:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 24 15:03:33.251120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:33.325791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:33.353017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d9c84-5a37-49d4-9897-45b225a60008 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:33.390588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:33.391241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:33.391521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:33.391787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] PATH_INFO: `/v3/services` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:33.392484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:03:33.392784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:33.395598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2e947-5701-4e5d-9fea-38605b117ed6 None admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:33.399488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 636/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Fri Jun 24 15:03:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:03:33.405384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:03:33.518276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea1b1be-6612-4855-9ae4-2bc00bdf2b85 None admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:03:33.550998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:03:33.551594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:03:33.555629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:03:33.555629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:03:33.555629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:03:33.555629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce732b1f-a483-4e3a-9fa5-966516318e7a None admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:03:33.644472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 670/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Fri Jun 24 15:03:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:03:43.430692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=30 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:03:43.637923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:03.050782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5e20-4ff8-4036-8295-561075332492 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:03.051346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5e20-4ff8-4036-8295-561075332492 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:03.051346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cc5e20-4ff8-4036-8295-561075332492 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:03.058865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e16b8-7daf-40e2-ba4f-1d737f9ff1c4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:03.059454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e16b8-7daf-40e2-ba4f-1d737f9ff1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:03.059454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e16b8-7daf-40e2-ba4f-1d737f9ff1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:03.063512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 637/1307] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:03.142626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e67e16b8-7daf-40e2-ba4f-1d737f9ff1c4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:03.143862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e67e16b8-7daf-40e2-ba4f-1d737f9ff1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:03.331066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 671/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:10:03.407657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:03.407911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:03.408197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:03.409943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 638/1309] 10.222.0.65 () {54 vars in 964 bytes} [Fri Jun 24 15:10:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:03.421276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9553c-7a1f-420e-8662-48fb7f68fec9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:03.421562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9553c-7a1f-420e-8662-48fb7f68fec9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:03.422381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9553c-7a1f-420e-8662-48fb7f68fec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:03.583134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-54d9553c-7a1f-420e-8662-48fb7f68fec9 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:03.585095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-54d9553c-7a1f-420e-8662-48fb7f68fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:03.631691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:03.764896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 672/1310] 10.222.0.65 () {58 vars in 1061 bytes} [Fri Jun 24 15:10:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:03.774150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:03.776186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:03.920951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7223-9dcf-4c58-be4a-96ed3e85e6bd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:04.014287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:04.015815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:04.016501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:04.017362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:04.019480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:04.089877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:04.160210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:04.162051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741572e0-49cc-4505-815b-e07855a467a8 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:04.183859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 639/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:06.576631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:06.577153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:06.577153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:06.578471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 673/1312] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:06.583546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ba2-aaf5-4fc6-9956-c35c33590c53 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:06.583977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ba2-aaf5-4fc6-9956-c35c33590c53 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:06.584084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5a1ba2-aaf5-4fc6-9956-c35c33590c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:06.670798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fd5a1ba2-aaf5-4fc6-9956-c35c33590c53 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:06.672621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fd5a1ba2-aaf5-4fc6-9956-c35c33590c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:06.779139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 640/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:06.823380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:06.824927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:06.928345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8fff4-0d13-40c5-9973-5e08b368e921 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:07.002718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:07.006133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:07.006781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:07.007061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:07.007341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:07.008994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:07.122003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:07.123535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ffa7f-23af-40f0-ab17-7cc6283cb912 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:07.141489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 674/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:09.790960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b145-ae29-453a-9601-a866fd760cf1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:09.791498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b145-ae29-453a-9601-a866fd760cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:09.791498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616b145-ae29-453a-9601-a866fd760cf1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:09.792887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 641/1315] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:09.798204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641b8b-8537-4dd0-b3db-040bf43a6376 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:09.798627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641b8b-8537-4dd0-b3db-040bf43a6376 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:09.798753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a641b8b-8537-4dd0-b3db-040bf43a6376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:09.862928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4a641b8b-8537-4dd0-b3db-040bf43a6376 None None] MFA Rules not processed for user `db788a4ba8014dbfb72bc12d8b2e5547`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:09.864142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4a641b8b-8537-4dd0-b3db-040bf43a6376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:09.916285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:09.961635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 675/1316] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:09 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:10.015505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:10.015791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:10.016065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:10.017462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 642/1317] 10.222.0.65 () {54 vars in 964 bytes} [Fri Jun 24 15:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:10.023950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f104a2-c1ba-4d55-b5fd-7876d38a05e7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:10.024231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f104a2-c1ba-4d55-b5fd-7876d38a05e7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:10.024501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f104a2-c1ba-4d55-b5fd-7876d38a05e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:10.096378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a1f104a2-c1ba-4d55-b5fd-7876d38a05e7 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:10.097482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a1f104a2-c1ba-4d55-b5fd-7876d38a05e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:10.172029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 676/1318] 10.222.0.65 () {58 vars in 1061 bytes} [Fri Jun 24 15:10:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:10.181049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:10.182584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:10.192648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:10.285433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bf204-ac55-47d4-ad60-13aaf709fa43 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:10.356243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:10.356875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:10.357406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:10.357674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:10.359930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:10.419507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:10.464478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:10.465920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fe5e9f-2c32-499c-a71c-2102083b0b96 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:10.484428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 643/1319] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:13.718742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:13.719314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:13.719591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:13.721017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 677/1320] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:13.726497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db785-0feb-46e8-911a-04135257d5d1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:13.726906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db785-0feb-46e8-911a-04135257d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:13.727053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424db785-0feb-46e8-911a-04135257d5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:13.790787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-424db785-0feb-46e8-911a-04135257d5d1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:13.792005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-424db785-0feb-46e8-911a-04135257d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:13.886444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 644/1321] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:10:13.926365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:13.927898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:13.978653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:14.032015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebbd50e-cb03-4fa7-a7df-1d254e778517 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:14.103043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:14.103691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:14.103972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:14.104245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:14.105909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:14.199396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:14.213343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:14.214820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5288bd-4854-4eff-b2ab-7fa839e98b42 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:14.233599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 678/1322] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:17.303459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:17.303984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:17.303984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:17.305370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 645/1323] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:17.310845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b48b-f8aa-49f1-8cd5-98053d22e638 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:17.311261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b48b-f8aa-49f1-8cd5-98053d22e638 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:17.311379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20b48b-f8aa-49f1-8cd5-98053d22e638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:17.377534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4a20b48b-f8aa-49f1-8cd5-98053d22e638 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:17.378760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4a20b48b-f8aa-49f1-8cd5-98053d22e638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:17.485549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 679/1324] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:17.521841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:17.523473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:17.542494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:17.642023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673944fc-2333-4111-80a7-8415346c92b5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:17.723232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:17.723885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:17.724164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:17.724433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:17.726242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:17.802927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:17.841666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:17.843559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b9c4ff-47ee-47e3-a22f-8fcfd1ab5745 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:17.862499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 646/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:19.976907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:19.977468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:19.977468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:19.979132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 680/1326] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:19.985389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a0e1-5dc5-4f23-a4c9-8d68bedbf0ff None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:19.985858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a0e1-5dc5-4f23-a4c9-8d68bedbf0ff None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:19.985970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0a0e1-5dc5-4f23-a4c9-8d68bedbf0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:20.054562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f7e0a0e1-5dc5-4f23-a4c9-8d68bedbf0ff None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:20.055815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f7e0a0e1-5dc5-4f23-a4c9-8d68bedbf0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:20.157680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 647/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:20.194224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:20.195747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:20.261685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:20.305557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d259a5c-7bd1-494c-81a2-ed3a1450a0d8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:20.383102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:20.383747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:20.384022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:20.384293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:20.385954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:20.495489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:20.497877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:20.499885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1453b344-a80a-472b-add3-b40de484980e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:20.517620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 681/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:22.642231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:22.642812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:22.642812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:22.644239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 648/1329] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:22.650220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff5cd-aa1f-455f-b2d4-a73a4bb9c3fe None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:22.650766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff5cd-aa1f-455f-b2d4-a73a4bb9c3fe None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:22.650859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ff5cd-aa1f-455f-b2d4-a73a4bb9c3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:22.720856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-987ff5cd-aa1f-455f-b2d4-a73a4bb9c3fe None None] MFA Rules not processed for user `db788a4ba8014dbfb72bc12d8b2e5547`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:22.722098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-987ff5cd-aa1f-455f-b2d4-a73a4bb9c3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:22.820539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 682/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:22.859129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:22.860657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:22.891675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:22.967644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf73e90-2b41-4088-bff2-3579b9f2803d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:23.049034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:23.049674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:23.049980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:23.050253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:23.051899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:23.132354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:23.165131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:23.166662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77df02b-74f8-4c3b-a99a-b9ba2db51116 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:23.186374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 649/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:25.830952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:25.831537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:25.831537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:25.832893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 683/1332] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:25.838013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14de-537b-4f5c-ac41-9d890d2392a8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:25.838407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14de-537b-4f5c-ac41-9d890d2392a8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:25.838570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc14de-537b-4f5c-ac41-9d890d2392a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:25.901790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-46cc14de-537b-4f5c-ac41-9d890d2392a8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:25.902987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-46cc14de-537b-4f5c-ac41-9d890d2392a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:25.997269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 650/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:26.033098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:26.034772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:26.104992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:26.139364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7eaa-d3c4-4fb9-ab3b-50a82c290f62 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:26.212794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:26.213440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:26.213745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:26.214031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:26.215680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:26.323999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:26.325421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b06f2-df44-4d40-93fa-674b3e4a0e87 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:26.335353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:26.344176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 684/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:28.442151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:28.442736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:28.442736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:28.444079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 651/1335] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:28.449356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98c7f-4bef-41e0-a9f4-76c48d82b0ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:28.449856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98c7f-4bef-41e0-a9f4-76c48d82b0ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:28.449961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c98c7f-4bef-41e0-a9f4-76c48d82b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:28.512970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f9c98c7f-4bef-41e0-a9f4-76c48d82b0ce None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:28.514107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f9c98c7f-4bef-41e0-a9f4-76c48d82b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:28.610233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 685/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:28.650901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:28.652493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:28.693142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:28.756189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398c417-3d68-4f6e-8191-1cb6efe4af12 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:28.828484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:28.829052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:28.829334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:28.829601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:28.831290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:28.913228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:28.938484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:28.940190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465d685e-5ab4-48f4-a612-29ea2e7b3374 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:28.958588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 652/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:31.651054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:31.651609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:31.651790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:31.653244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 686/1338] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:31.658612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813db7-5d9c-432b-8c66-19b59a404e9c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:31.659036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813db7-5d9c-432b-8c66-19b59a404e9c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:31.659173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b813db7-5d9c-432b-8c66-19b59a404e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:31.725150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7b813db7-5d9c-432b-8c66-19b59a404e9c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:31.726398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7b813db7-5d9c-432b-8c66-19b59a404e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:31.821544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 653/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:31 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:31.858582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:31.860692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:31.937640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:31.965471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03530d0-2550-476c-9a40-95f0f35190aa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:32.039576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:32.040212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:32.040490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:32.040764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:32.042433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:32.152827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:32.154316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc67acf7-298b-4ffd-96f3-03043fb15f42 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:32.172988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 687/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:36.555659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:36.556368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:36.556368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:36.557924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 654/1341] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:36.564497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eb575-3c2f-43e1-9488-4c20a08cdf2f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:36.564497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eb575-3c2f-43e1-9488-4c20a08cdf2f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:36.564497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82eb575-3c2f-43e1-9488-4c20a08cdf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:36.571534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:36.642732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f82eb575-3c2f-43e1-9488-4c20a08cdf2f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:36.643948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f82eb575-3c2f-43e1-9488-4c20a08cdf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:36.758193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 688/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:36.797711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:36.799896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:36.851794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:36.900375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eda01-e9e5-4c4d-81e8-65659509b2e8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:36.903956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:36.904600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:36.904884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:36.905159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:36.914371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:36.915795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c830b-177d-47ff-ac98-cc71610f38f2 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:36.925246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 655/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:39.917450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfffce-7bc7-4e38-9299-a131d27dff8c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:39.918060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfffce-7bc7-4e38-9299-a131d27dff8c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:39.918176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfffce-7bc7-4e38-9299-a131d27dff8c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:39.919643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 689/1344] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:39.925513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf116f1-1ad5-466a-8f5a-c74f24a15cd8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:39.926068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf116f1-1ad5-466a-8f5a-c74f24a15cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:39.926180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf116f1-1ad5-466a-8f5a-c74f24a15cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:39.957108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9cf116f1-1ad5-466a-8f5a-c74f24a15cd8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:39.958413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9cf116f1-1ad5-466a-8f5a-c74f24a15cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:40.053953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 656/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:40.092241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfffce-7bc7-4e38-9299-a131d27dff8c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:40.103201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfffce-7bc7-4e38-9299-a131d27dff8c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:40.107073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:40.108192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:40.108494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:40.108745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:40.119163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:40.120624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1098f-ed06-494b-b2d8-deb7964b4fe6 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:40.130994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 690/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:44.539257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d9b2-b268-4217-bec6-b4610f548d98 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:44.539739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d9b2-b268-4217-bec6-b4610f548d98 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:44.539847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8d9b2-b268-4217-bec6-b4610f548d98 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:44.541160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 657/1347] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:44.547072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48416e-9f6d-446d-b996-548e1a5db8b6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:44.547559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48416e-9f6d-446d-b996-548e1a5db8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:44.547763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48416e-9f6d-446d-b996-548e1a5db8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:44.566608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4a48416e-9f6d-446d-b996-548e1a5db8b6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:44.567821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4a48416e-9f6d-446d-b996-548e1a5db8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:44.575781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 691/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:44.613966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d9b2-b268-4217-bec6-b4610f548d98 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:44.625241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8d9b2-b268-4217-bec6-b4610f548d98 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:44.628987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:44.629859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:44.629997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:44.630200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:44.639778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:44.641237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747f53c-1c07-4c63-bbe7-1da8d28ac4cb service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:44.651829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 658/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:10:49.688350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b29d7-bc8c-4ea8-9a5c-cd55878a6705 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:49.688880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b29d7-bc8c-4ea8-9a5c-cd55878a6705 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:49.688880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b29d7-bc8c-4ea8-9a5c-cd55878a6705 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:49.690841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 692/1350] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:49.696014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7cda-fe55-4af3-a999-92831e791a2f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:49.704365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7cda-fe55-4af3-a999-92831e791a2f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:49.704365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf7cda-fe55-4af3-a999-92831e791a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:49.776726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b4bf7cda-fe55-4af3-a999-92831e791a2f None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:49.778162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b4bf7cda-fe55-4af3-a999-92831e791a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:49.870695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:49.911326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 659/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:10:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:54.096660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221755-9639-4c3c-b213-1e83428ddfe4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:54.097192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221755-9639-4c3c-b213-1e83428ddfe4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:54.097192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00221755-9639-4c3c-b213-1e83428ddfe4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:54.098622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 693/1352] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:54.105207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631880b7-dc2f-4009-b379-15fad67e8025 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:54.105707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631880b7-dc2f-4009-b379-15fad67e8025 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:54.106149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631880b7-dc2f-4009-b379-15fad67e8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:54.125564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-631880b7-dc2f-4009-b379-15fad67e8025 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:54.126794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-631880b7-dc2f-4009-b379-15fad67e8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:54.136870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 660/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:10:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:54.561290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=72 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:10:55.764624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c805b-0a6f-40b9-a72d-40e9d61f070c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:55.765251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c805b-0a6f-40b9-a72d-40e9d61f070c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:55.765251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c805b-0a6f-40b9-a72d-40e9d61f070c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:55.766613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 694/1354] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:55.771805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cdcc-7f99-45ff-b673-62eb99524281 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:55.773314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cdcc-7f99-45ff-b673-62eb99524281 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:55.773314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9cdcc-7f99-45ff-b673-62eb99524281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:55.792540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a3b9cdcc-7f99-45ff-b673-62eb99524281 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:55.793864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a3b9cdcc-7f99-45ff-b673-62eb99524281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:55.803303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 661/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:10:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:59.498011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d349c1-cad0-4dcf-ab68-7ca77a2be743 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:59.498909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d349c1-cad0-4dcf-ab68-7ca77a2be743 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:59.499353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d349c1-cad0-4dcf-ab68-7ca77a2be743 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:59.505241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 695/1356] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:10:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:59.507226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255978d4-ca9d-4644-98cf-cbbbac8f8032 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:59.508093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255978d4-ca9d-4644-98cf-cbbbac8f8032 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:59.508541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255978d4-ca9d-4644-98cf-cbbbac8f8032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:59.536325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-255978d4-ca9d-4644-98cf-cbbbac8f8032 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:59.537524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-255978d4-ca9d-4644-98cf-cbbbac8f8032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:59.553252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 662/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:59.610866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768986e-0d46-407c-adc7-2ceac255f2e1 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:59.611448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768986e-0d46-407c-adc7-2ceac255f2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:59.611934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768986e-0d46-407c-adc7-2ceac255f2e1 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:59.614009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 696/1358] 10.222.0.65 () {54 vars in 961 bytes} [Fri Jun 24 15:10:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:10:59.625223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810547c-ae37-40e6-a165-cb6425a6bd6c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:59.625960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810547c-ae37-40e6-a165-cb6425a6bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:59.626450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810547c-ae37-40e6-a165-cb6425a6bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:59.684257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5810547c-ae37-40e6-a165-cb6425a6bd6c None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:10:59.685482 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5810547c-ae37-40e6-a165-cb6425a6bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:10:59.777803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 663/1359] 10.222.0.65 () {58 vars in 1058 bytes} [Fri Jun 24 15:10:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:10:59.786418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768986e-0d46-407c-adc7-2ceac255f2e1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:10:59.803852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768986e-0d46-407c-adc7-2ceac255f2e1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:10:59.810860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:10:59.811780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:10:59.812379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:10:59.813015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:10:59.822987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:10:59.824877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac1e52-3a52-487d-baa0-39913aa04b71 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:10:59.836061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 697/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:02.111123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f112d3-b423-4f1b-9924-f243cb5bc53a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:02.111659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f112d3-b423-4f1b-9924-f243cb5bc53a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:02.111659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f112d3-b423-4f1b-9924-f243cb5bc53a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:02.113197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 664/1361] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:02.118306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eb9-f21a-4c1d-b853-2bd8fac56411 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:02.118727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eb9-f21a-4c1d-b853-2bd8fac56411 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:02.118851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba00eb9-f21a-4c1d-b853-2bd8fac56411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:02.137617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4ba00eb9-f21a-4c1d-b853-2bd8fac56411 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:02.139169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4ba00eb9-f21a-4c1d-b853-2bd8fac56411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:02.147223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 698/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:02.197539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f112d3-b423-4f1b-9924-f243cb5bc53a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:02.213377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f112d3-b423-4f1b-9924-f243cb5bc53a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:02.219219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:02.219870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:02.220154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:02.220425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:02.231567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:02.233751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0988c7c-3081-4d85-b45d-79bebb7e6b65 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:02.244619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 665/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:04.910313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065bcd9-602e-4dcf-b5f0-6be2e92852ca None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:04.910868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065bcd9-602e-4dcf-b5f0-6be2e92852ca None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:04.910868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065bcd9-602e-4dcf-b5f0-6be2e92852ca None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:04.912321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 699/1364] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:11:04.917751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66046f08-a541-448b-9886-e9ee941d8b85 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:04.918189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66046f08-a541-448b-9886-e9ee941d8b85 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:04.918297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66046f08-a541-448b-9886-e9ee941d8b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:04.939550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-66046f08-a541-448b-9886-e9ee941d8b85 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:04.940743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-66046f08-a541-448b-9886-e9ee941d8b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:04.951755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 666/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:04.997787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a71a-e21d-4234-b7ba-5a315853bda5 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:04.998070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a71a-e21d-4234-b7ba-5a315853bda5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:04.998869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868a71a-e21d-4234-b7ba-5a315853bda5 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:05.000229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 700/1366] 10.222.0.65 () {54 vars in 961 bytes} [Fri Jun 24 15:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:05.005701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a88c-ad97-4bb7-a3e3-5e00a05c4f9d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:05.006024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a88c-ad97-4bb7-a3e3-5e00a05c4f9d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:05.006302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13a88c-ad97-4bb7-a3e3-5e00a05c4f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:05.024101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1c13a88c-ad97-4bb7-a3e3-5e00a05c4f9d None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:05.025276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1c13a88c-ad97-4bb7-a3e3-5e00a05c4f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:05.036534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 667/1367] 10.222.0.65 () {58 vars in 1058 bytes} [Fri Jun 24 15:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:05.050564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a71a-e21d-4234-b7ba-5a315853bda5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:05.069967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868a71a-e21d-4234-b7ba-5a315853bda5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:05.075374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:05.076314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:05.076597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:05.076872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:05.085191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:05.086786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d31f30-b660-46ed-b986-9cb452f3839a service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:05.106207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 701/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:11:07.431442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1df1-2f80-42fd-a062-dcb281f0476a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:07.432012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1df1-2f80-42fd-a062-dcb281f0476a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:07.432012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b1df1-2f80-42fd-a062-dcb281f0476a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:07.433355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 668/1369] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:07.439439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae365e-ca55-4a91-9d4a-e825cfb1ae93 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:07.439916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae365e-ca55-4a91-9d4a-e825cfb1ae93 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:07.440008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae365e-ca55-4a91-9d4a-e825cfb1ae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:07.458396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1bae365e-ca55-4a91-9d4a-e825cfb1ae93 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:07.459631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1bae365e-ca55-4a91-9d4a-e825cfb1ae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:07.467896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 702/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:07.511542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1df1-2f80-42fd-a062-dcb281f0476a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:07.531155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b1df1-2f80-42fd-a062-dcb281f0476a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:07.537611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:07.538505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:07.538802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:07.539187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:07.548684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:07.550884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ebf58-5c36-4718-8352-eb9f6524346b service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:07.561764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 669/1371] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:07.796666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047915-88df-4416-94f2-dca6c81bac4d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:07.797232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047915-88df-4416-94f2-dca6c81bac4d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:07.797677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c047915-88df-4416-94f2-dca6c81bac4d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:07.803003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 703/1372] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:07.806513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356661-9300-4bbe-a01a-9e2fed0e705e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:07.806806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356661-9300-4bbe-a01a-9e2fed0e705e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:07.807081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356661-9300-4bbe-a01a-9e2fed0e705e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:07.827832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cf356661-9300-4bbe-a01a-9e2fed0e705e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:07.829256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cf356661-9300-4bbe-a01a-9e2fed0e705e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:07.843187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 670/1373] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:08.146496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62508-a482-4dd9-baec-5f29ab9bdd0e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:08.146778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62508-a482-4dd9-baec-5f29ab9bdd0e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:08.147262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f62508-a482-4dd9-baec-5f29ab9bdd0e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:08.148834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 704/1374] 10.222.0.65 () {54 vars in 963 bytes} [Fri Jun 24 15:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:08.154820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd7e0-86df-4327-8382-dfa567ba5033 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:08.155345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd7e0-86df-4327-8382-dfa567ba5033 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:08.155772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1fd7e0-86df-4327-8382-dfa567ba5033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:08.163740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:08.210764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ba1fd7e0-86df-4327-8382-dfa567ba5033 None None] MFA Rules not processed for user `d167f6076c5745169fede7f865e056da`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:08.211973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ba1fd7e0-86df-4327-8382-dfa567ba5033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:08.285389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 671/1375] 10.222.0.65 () {58 vars in 1060 bytes} [Fri Jun 24 15:11:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:08.293101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f62508-a482-4dd9-baec-5f29ab9bdd0e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:08.304796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f62508-a482-4dd9-baec-5f29ab9bdd0e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:08.308442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:08.309068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:08.309346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:08.309873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:08.319545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:08.321153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9723a4-a3f2-4537-ab7b-7d6cd82d55b5 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:08.331080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 705/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:09.757970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f46a2-ee25-4e5f-85e2-7585298fece4 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:09.758634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f46a2-ee25-4e5f-85e2-7585298fece4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:09.758634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f46a2-ee25-4e5f-85e2-7585298fece4 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:09.759945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 672/1377] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:09.766046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba014e6-60f1-455b-a88f-2f3516a9842a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:09.766530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba014e6-60f1-455b-a88f-2f3516a9842a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:09.766640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba014e6-60f1-455b-a88f-2f3516a9842a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:09.784662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-dba014e6-60f1-455b-a88f-2f3516a9842a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:09.785875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dba014e6-60f1-455b-a88f-2f3516a9842a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:09.793762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 706/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:09.838764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f46a2-ee25-4e5f-85e2-7585298fece4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:09.853163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f46a2-ee25-4e5f-85e2-7585298fece4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:09.858909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:09.859549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:09.863540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:09.863540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:09.868660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:09.870346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4408072-1860-4861-ad05-c15db026ef65 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:09.880556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 673/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:12.108828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78187-77a5-4f0c-953b-2d3dea58a259 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:12.109682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78187-77a5-4f0c-953b-2d3dea58a259 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:12.110180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d78187-77a5-4f0c-953b-2d3dea58a259 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:12.112022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 707/1380] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:12.117623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3d11-ac33-4323-9e93-2ae9930ec08a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:12.118600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3d11-ac33-4323-9e93-2ae9930ec08a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:12.119121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3d11-ac33-4323-9e93-2ae9930ec08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:12.138144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b23b3d11-ac33-4323-9e93-2ae9930ec08a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:12.139475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b23b3d11-ac33-4323-9e93-2ae9930ec08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:12.147601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 674/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:12.193009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78187-77a5-4f0c-953b-2d3dea58a259 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:12.209293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d78187-77a5-4f0c-953b-2d3dea58a259 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:12.215148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:12.216642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:12.217039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:12.217487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:12.227221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:12.228917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e26566-f3be-4261-bfc4-0e5b9d3bb302 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:12.239461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 708/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:14.456950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63ccae-ecbd-4aa4-8df8-c57492af0821 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:14.457505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63ccae-ecbd-4aa4-8df8-c57492af0821 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:14.457686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63ccae-ecbd-4aa4-8df8-c57492af0821 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:14.458954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 675/1383] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:14.464721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393394-9df4-4a5d-ae73-e953c3909971 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:14.465167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393394-9df4-4a5d-ae73-e953c3909971 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:14.465278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5393394-9df4-4a5d-ae73-e953c3909971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:14.485044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f5393394-9df4-4a5d-ae73-e953c3909971 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:14.486343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f5393394-9df4-4a5d-ae73-e953c3909971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:14.494156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 709/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:14.535809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63ccae-ecbd-4aa4-8df8-c57492af0821 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:14.550716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63ccae-ecbd-4aa4-8df8-c57492af0821 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:14.556411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:14.557042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:14.557320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:14.557591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:14.566849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:14.571021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09fd992-82fa-4306-a22c-9620e77d73e5 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:14.577676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 676/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:16.758267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bfc9-db93-4bb9-99b4-8ac5e06aa2ef None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:16.758829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bfc9-db93-4bb9-99b4-8ac5e06aa2ef None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:16.759035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532bfc9-db93-4bb9-99b4-8ac5e06aa2ef None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:16.761272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 710/1386] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:16.767251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c25f-255a-4aee-8558-cdd28d42662c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:16.767713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c25f-255a-4aee-8558-cdd28d42662c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:16.767794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305c25f-255a-4aee-8558-cdd28d42662c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:16.787234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d305c25f-255a-4aee-8558-cdd28d42662c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:16.788444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d305c25f-255a-4aee-8558-cdd28d42662c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:16.796496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 677/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:16.842142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532bfc9-db93-4bb9-99b4-8ac5e06aa2ef None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:16.860253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532bfc9-db93-4bb9-99b4-8ac5e06aa2ef None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:16.867249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:16.868099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:16.868457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:16.868833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:16.880098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:16.882159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749c19b-49b8-4519-9445-c137bb5c0fc2 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:16.896377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 711/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:19.117599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12863-0907-449a-99d9-255ba7710b64 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:19.118191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12863-0907-449a-99d9-255ba7710b64 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:19.118444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a12863-0907-449a-99d9-255ba7710b64 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:19.120137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 678/1389] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:19.127935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6f46-ca2c-44f3-a227-fd3f24062ecb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:19.127935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6f46-ca2c-44f3-a227-fd3f24062ecb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:19.127935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44de6f46-ca2c-44f3-a227-fd3f24062ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:19.152295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-44de6f46-ca2c-44f3-a227-fd3f24062ecb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:19.154132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-44de6f46-ca2c-44f3-a227-fd3f24062ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:19.167043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 712/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:19.214037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12863-0907-449a-99d9-255ba7710b64 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:19.233632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a12863-0907-449a-99d9-255ba7710b64 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:19.240640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:19.241422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:19.241881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:19.242212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:19.253659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:19.255948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c05d32e-5d8e-46d6-8177-be2df513c017 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:19.267964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 679/1391] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:21.555930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465331c-5974-45ac-9ca2-0bede84e2b4e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:21.556603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465331c-5974-45ac-9ca2-0bede84e2b4e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:21.556776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465331c-5974-45ac-9ca2-0bede84e2b4e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:21.558835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 713/1392] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:21.567111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222d11-217d-4500-b20b-23642daeb0a0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:21.567589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222d11-217d-4500-b20b-23642daeb0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:21.567806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01222d11-217d-4500-b20b-23642daeb0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:21.593901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-01222d11-217d-4500-b20b-23642daeb0a0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:21.595129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01222d11-217d-4500-b20b-23642daeb0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:21.603356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 680/1393] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:21.648693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465331c-5974-45ac-9ca2-0bede84e2b4e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:21.663190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465331c-5974-45ac-9ca2-0bede84e2b4e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:21.670804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:21.670804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:21.670804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:21.670804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:21.683107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:21.686639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1ded0-de21-4fb0-9cdb-ac25fd65a3e1 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:21.699223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 714/1394] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:23.827970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a684c94-cbcb-4d33-968a-015800906fbc None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.828602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a684c94-cbcb-4d33-968a-015800906fbc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.828602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a684c94-cbcb-4d33-968a-015800906fbc None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.829940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 681/1395] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:23.835414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190c46-ffdb-4231-b734-b3fbe2fcd40e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.835860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190c46-ffdb-4231-b734-b3fbe2fcd40e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.836096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02190c46-ffdb-4231-b734-b3fbe2fcd40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.854591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-02190c46-ffdb-4231-b734-b3fbe2fcd40e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:23.856052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-02190c46-ffdb-4231-b734-b3fbe2fcd40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:23.863897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 715/1396] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:23.920068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad542bc-28d3-448d-a224-472ddced8bd9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.920354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad542bc-28d3-448d-a224-472ddced8bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.920630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad542bc-28d3-448d-a224-472ddced8bd9 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.922046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 682/1397] 10.222.0.65 () {54 vars in 962 bytes} [Fri Jun 24 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:23.926992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.927283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.928615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.951607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81776206-3a11-4b90-b259-3e0be531de68 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.951886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81776206-3a11-4b90-b259-3e0be531de68 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.952155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81776206-3a11-4b90-b259-3e0be531de68 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.953870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 683/1398] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:11:23.959113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:23.959415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:23.959701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:23.977325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:23.978556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:23.979775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] MFA Rules not processed for user `53da70e1f5bf46ec924902edf423ca91`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:23.981746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:23.987450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 684/1399] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:24.031645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:24.043166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 716/1400] 10.222.0.65 () {58 vars in 1059 bytes} [Fri Jun 24 15:11:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:24.045807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed4a0c4-8830-4c7b-94ce-427f286f5613 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:24.051288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:24.051457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:24.051928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:24.052207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:24.052481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:24.058800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6660282-9f1a-4009-829c-2fed0de8a93e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:24.061047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:24.062647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:24.062814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5901fe7-427a-47dc-8795-8ec124f34594 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:24.063285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:24.063566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:24.063840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:24.072347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 685/1401] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:24.073028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:24.074472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e95ea-0e38-4f28-8798-35503909f8f6 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:24.084176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 717/1402] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:11:24.975564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf669e-ac41-4b0e-b8ec-b835458e3969 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:24.976059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf669e-ac41-4b0e-b8ec-b835458e3969 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:24.976163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf669e-ac41-4b0e-b8ec-b835458e3969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:25.025851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5abf669e-ac41-4b0e-b8ec-b835458e3969 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:25.027078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5abf669e-ac41-4b0e-b8ec-b835458e3969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:25.059804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:25.090217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 686/1403] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:11:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:25.133286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0f30-1f9d-4e88-a67b-c2a72146b840 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:25.133862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0f30-1f9d-4e88-a67b-c2a72146b840 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:25.134042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bef0f30-1f9d-4e88-a67b-c2a72146b840 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:25.135503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 718/1404] 10.222.0.65 () {54 vars in 942 bytes} [Fri Jun 24 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:25.142192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ea9a-6823-4e23-afe3-f8f1ad9fc868 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:25.142480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ea9a-6823-4e23-afe3-f8f1ad9fc868 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:25.142778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34ea9a-6823-4e23-afe3-f8f1ad9fc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:25.191864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5f34ea9a-6823-4e23-afe3-f8f1ad9fc868 None None] MFA Rules not processed for user `bd11123cb5a64281b8c0336ee2a56f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:25.193073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5f34ea9a-6823-4e23-afe3-f8f1ad9fc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:25.269086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 687/1405] 10.222.0.65 () {58 vars in 1039 bytes} [Fri Jun 24 15:11:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:25.278666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0f30-1f9d-4e88-a67b-c2a72146b840 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:25.286180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:25.293026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bef0f30-1f9d-4e88-a67b-c2a72146b840 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:25.298621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:25.299331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:25.299677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:25.300034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:25.308476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:25.310785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4214c-6d03-496f-a755-65f62c911e7c service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:25.319398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 719/1406] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:11:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:11:26.295155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7320c-9f26-41e7-88e9-ea8905cf664a None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:26.295714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7320c-9f26-41e7-88e9-ea8905cf664a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:26.295714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7320c-9f26-41e7-88e9-ea8905cf664a None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:26.297302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 688/1407] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:26.302740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357777f7-bde7-4435-95c8-b0f2e3d7ba6c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:26.303201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357777f7-bde7-4435-95c8-b0f2e3d7ba6c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:26.303297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357777f7-bde7-4435-95c8-b0f2e3d7ba6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:26.321480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-357777f7-bde7-4435-95c8-b0f2e3d7ba6c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:26.322966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-357777f7-bde7-4435-95c8-b0f2e3d7ba6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:26.331645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 720/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:26.377682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7320c-9f26-41e7-88e9-ea8905cf664a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:26.394924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7320c-9f26-41e7-88e9-ea8905cf664a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:26.400403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:26.401173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:26.401458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:26.401744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:26.411651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:26.413428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b093c2f-31e5-4bef-b5d2-78617d98723c service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:26.425590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 689/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:36.315734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:36.419912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=62 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:11:49.773162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c147-5266-4ef4-9ec0-f51b52f8f499 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:49.773792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c147-5266-4ef4-9ec0-f51b52f8f499 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:49.773792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f4c147-5266-4ef4-9ec0-f51b52f8f499 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:49.775099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 721/1410] 10.222.0.65 () {54 vars in 918 bytes} [Fri Jun 24 15:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:49.780793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcfa9-84c3-49b8-af46-130eaffe03f6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:49.781249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcfa9-84c3-49b8-af46-130eaffe03f6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:49.781421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eafcfa9-84c3-49b8-af46-130eaffe03f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:49.799001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7eafcfa9-84c3-49b8-af46-130eaffe03f6 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:49.800188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7eafcfa9-84c3-49b8-af46-130eaffe03f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:49.809029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 690/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Jun 24 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:49.823661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b830-ead7-45da-9595-42e1852a957d None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:49.823941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b830-ead7-45da-9595-42e1852a957d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:49.824213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4b830-ead7-45da-9595-42e1852a957d None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:49.825560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 722/1412] 10.222.0.65 () {54 vars in 918 bytes} [Fri Jun 24 15:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:49.830785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ae97-739c-4a66-8ee9-cbaaab6946a6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:49.831069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ae97-739c-4a66-8ee9-cbaaab6946a6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:49.831332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440ae97-739c-4a66-8ee9-cbaaab6946a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:49.855310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8440ae97-739c-4a66-8ee9-cbaaab6946a6 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:49.856514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8440ae97-739c-4a66-8ee9-cbaaab6946a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:49.865669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 691/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Fri Jun 24 15:11:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:52.406114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02c90-dfd9-4df7-8966-e8918cd3266a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:52.406678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02c90-dfd9-4df7-8966-e8918cd3266a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:52.406678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f02c90-dfd9-4df7-8966-e8918cd3266a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:52.408104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 723/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:52.413590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44ce2-cfe4-4b31-ac70-0821065fd8e3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:52.414109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44ce2-cfe4-4b31-ac70-0821065fd8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:52.414213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb44ce2-cfe4-4b31-ac70-0821065fd8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:52.432237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9fb44ce2-cfe4-4b31-ac70-0821065fd8e3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:52.433789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9fb44ce2-cfe4-4b31-ac70-0821065fd8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:52.441728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 692/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:11:52.485947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02c90-dfd9-4df7-8966-e8918cd3266a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:52.501012 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f02c90-dfd9-4df7-8966-e8918cd3266a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:52.506531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:52.507193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:52.507471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:52.507745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:52.516769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:52.518412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3c12b3-dad6-4a56-a0f9-2c452ae07654 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:52.528900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 724/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:53.440946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feed2-2b42-4c85-b5c3-62ee355b37b3 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:53.441472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feed2-2b42-4c85-b5c3-62ee355b37b3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:53.441472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73feed2-2b42-4c85-b5c3-62ee355b37b3 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:53.442805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 693/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:53.447789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b601-01b2-495b-83f7-17e8fa1d35a3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:53.448197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b601-01b2-495b-83f7-17e8fa1d35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:53.448347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b601-01b2-495b-83f7-17e8fa1d35a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:53.466219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ff00b601-01b2-495b-83f7-17e8fa1d35a3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:53.467455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ff00b601-01b2-495b-83f7-17e8fa1d35a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:53.475414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 725/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:53.629316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73feed2-2b42-4c85-b5c3-62ee355b37b3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:53.644057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73feed2-2b42-4c85-b5c3-62ee355b37b3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:53.650868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:53.651516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:53.651794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:53.652064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:53.661064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:53.662670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57918c29-c9c9-4b9c-a561-fa449095c46e service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:53.673635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 694/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:54.570950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391aad5-7b16-45a8-89d7-a22d15ee8bdd None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:54.571517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391aad5-7b16-45a8-89d7-a22d15ee8bdd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:54.571517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391aad5-7b16-45a8-89d7-a22d15ee8bdd None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:54.572792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 726/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:54.577782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7657d8-de34-494f-bb2e-9b74f0e00767 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:54.578179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7657d8-de34-494f-bb2e-9b74f0e00767 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:54.578329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7657d8-de34-494f-bb2e-9b74f0e00767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:54.597233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8c7657d8-de34-494f-bb2e-9b74f0e00767 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:54.598457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8c7657d8-de34-494f-bb2e-9b74f0e00767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:54.606461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 695/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:54.758187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391aad5-7b16-45a8-89d7-a22d15ee8bdd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:54.772882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391aad5-7b16-45a8-89d7-a22d15ee8bdd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:54.778365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:54.778994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:54.779275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:54.780111 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:54.788309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:54.789912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d15159-59d7-47bf-af2f-1a2e155fbe37 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:54.800126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 727/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:55.666521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8646a-e3a4-43e5-8c45-7aec24486f55 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:55.667079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8646a-e3a4-43e5-8c45-7aec24486f55 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:55.667079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c8646a-e3a4-43e5-8c45-7aec24486f55 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:55.668446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 696/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:55.673974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016771-6a2c-4583-bc36-b94a24a5fb69 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:55.674413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016771-6a2c-4583-bc36-b94a24a5fb69 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:55.674619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84016771-6a2c-4583-bc36-b94a24a5fb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:55.693308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-84016771-6a2c-4583-bc36-b94a24a5fb69 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:55.694567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-84016771-6a2c-4583-bc36-b94a24a5fb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:55.702406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 728/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:55.850354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8646a-e3a4-43e5-8c45-7aec24486f55 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:55.865019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c8646a-e3a4-43e5-8c45-7aec24486f55 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:55.870902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:55.871531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:55.871809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:55.872076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:55.881033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:55.882640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99f336-54e6-4174-afd8-1d71a94144d6 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:55.891958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 697/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:56.755392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129f47-6762-4c7e-a9ec-3da3dfb92e09 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:56.755960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129f47-6762-4c7e-a9ec-3da3dfb92e09 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:56.755960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4129f47-6762-4c7e-a9ec-3da3dfb92e09 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:56.757322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 729/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:56.762261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d912-eb6a-474e-86c2-60e6a2557f28 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:56.762705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d912-eb6a-474e-86c2-60e6a2557f28 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:56.762848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc67d912-eb6a-474e-86c2-60e6a2557f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:56.781186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dc67d912-eb6a-474e-86c2-60e6a2557f28 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:56.782411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dc67d912-eb6a-474e-86c2-60e6a2557f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:56.790148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 698/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:56.939495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129f47-6762-4c7e-a9ec-3da3dfb92e09 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:56.954231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4129f47-6762-4c7e-a9ec-3da3dfb92e09 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:56.959740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:56.960387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:56.960671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:56.960984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:56.969254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:56.970868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f433694-534f-4fe6-b46b-c07c56f19454 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:56.980458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 730/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:57.856264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbef0c-ca8d-439e-bf1a-1c75a4dc7d92 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:57.856838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbef0c-ca8d-439e-bf1a-1c75a4dc7d92 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:57.856838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbef0c-ca8d-439e-bf1a-1c75a4dc7d92 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:57.858945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 699/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:57.864001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd73-0d10-48f5-941b-8c17ef94e509 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:57.864397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd73-0d10-48f5-941b-8c17ef94e509 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:57.864558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bd73-0d10-48f5-941b-8c17ef94e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:57.882450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9339bd73-0d10-48f5-941b-8c17ef94e509 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:57.883633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9339bd73-0d10-48f5-941b-8c17ef94e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:57.891942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 731/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:58.040221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbef0c-ca8d-439e-bf1a-1c75a4dc7d92 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:58.054498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbef0c-ca8d-439e-bf1a-1c75a4dc7d92 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:58.059748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:58.060360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:58.060667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:58.060934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:58.068861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:58.070525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046368e-f9a6-4fef-b61d-441b60315111 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:58.080239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 700/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:11:58.951752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba5d1-b887-4a3b-b017-5c60a2a94d01 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:58.952350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba5d1-b887-4a3b-b017-5c60a2a94d01 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:58.952350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfba5d1-b887-4a3b-b017-5c60a2a94d01 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:58.953681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 732/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:11:58.958629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb74-47d4-41e4-96a5-a9171baddc0a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:58.959016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb74-47d4-41e4-96a5-a9171baddc0a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:58.959180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0eb74-47d4-41e4-96a5-a9171baddc0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:58.976714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-61f0eb74-47d4-41e4-96a5-a9171baddc0a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:11:58.977943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-61f0eb74-47d4-41e4-96a5-a9171baddc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:11:58.986501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 701/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:11:59.135298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfba5d1-b887-4a3b-b017-5c60a2a94d01 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:11:59.149385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfba5d1-b887-4a3b-b017-5c60a2a94d01 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:11:59.155244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:11:59.155870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:11:59.156149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:11:59.156423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:11:59.164726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:11:59.166385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69910bb1-00b6-433e-a821-0c93db4e9c8d service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:11:59.176501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 733/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:00.056692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32402-a4dd-4141-b329-7d7d14aafa59 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:00.057953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32402-a4dd-4141-b329-7d7d14aafa59 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:00.058605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e32402-a4dd-4141-b329-7d7d14aafa59 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:00.060057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 702/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:12:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:00.066009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4a7a-c81c-41c3-845b-eb0bdf556c77 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:00.066606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4a7a-c81c-41c3-845b-eb0bdf556c77 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:00.066606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d4a7a-c81c-41c3-845b-eb0bdf556c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:00.084785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e36d4a7a-c81c-41c3-845b-eb0bdf556c77 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:00.086067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e36d4a7a-c81c-41c3-845b-eb0bdf556c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:00.093929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 734/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:00.251415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32402-a4dd-4141-b329-7d7d14aafa59 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:00.265299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e32402-a4dd-4141-b329-7d7d14aafa59 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:00.270498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:00.271398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:00.271676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:00.271959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:00.280653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:00.282275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53857b-8eb1-4611-83e0-24ecda64f508 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:00.292095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 703/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:01.244070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248094ca-3d6b-4efe-90c2-a4de4ecfc1b4 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:01.244570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248094ca-3d6b-4efe-90c2-a4de4ecfc1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:01.244691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248094ca-3d6b-4efe-90c2-a4de4ecfc1b4 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:01.246094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 735/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:01.252044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1335f6-8dd3-4800-8d22-32e75488a6a9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:01.252525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1335f6-8dd3-4800-8d22-32e75488a6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:01.252631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1335f6-8dd3-4800-8d22-32e75488a6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:01.271818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cf1335f6-8dd3-4800-8d22-32e75488a6a9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:01.273083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cf1335f6-8dd3-4800-8d22-32e75488a6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:01.280928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 704/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:12:01.429971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248094ca-3d6b-4efe-90c2-a4de4ecfc1b4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:01.445483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248094ca-3d6b-4efe-90c2-a4de4ecfc1b4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:01.450913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:01.452133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:01.452412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:01.452687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:01.461004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:01.462599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36068029-4aeb-4097-b347-f47804249d8a service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:01.472248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 736/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:03.421780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56dbb-6e08-43b4-a185-f66596c715a5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:03.422313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56dbb-6e08-43b4-a185-f66596c715a5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:03.422313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e56dbb-6e08-43b4-a185-f66596c715a5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:03.423624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 705/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:03.428863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6a52-0a67-47a2-8825-fe5f8c8a3b45 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:03.429304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6a52-0a67-47a2-8825-fe5f8c8a3b45 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:03.429419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f6a52-0a67-47a2-8825-fe5f8c8a3b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:03.447889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-214f6a52-0a67-47a2-8825-fe5f8c8a3b45 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:03.449092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-214f6a52-0a67-47a2-8825-fe5f8c8a3b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:03.457166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 737/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:03.496076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e56dbb-6e08-43b4-a185-f66596c715a5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:03.508193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e56dbb-6e08-43b4-a185-f66596c715a5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:03.511762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:03.512397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:03.512679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:03.512952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:03.529987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:03.531523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43a60f-c94c-4332-a4cd-dd471b6133d7 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:03.541834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 706/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:05.783796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b157-d0ba-4f5d-bdcc-21f7805c8073 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:05.784333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b157-d0ba-4f5d-bdcc-21f7805c8073 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:05.784333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b157-d0ba-4f5d-bdcc-21f7805c8073 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:05.785643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 738/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:05.791479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6ca89-becb-49e8-ad25-25b023919b87 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:05.791937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6ca89-becb-49e8-ad25-25b023919b87 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:05.792034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef6ca89-becb-49e8-ad25-25b023919b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:05.814089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5ef6ca89-becb-49e8-ad25-25b023919b87 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:05.815299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5ef6ca89-becb-49e8-ad25-25b023919b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:05.823361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 707/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:05.863529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633b157-d0ba-4f5d-bdcc-21f7805c8073 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:05.874941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633b157-d0ba-4f5d-bdcc-21f7805c8073 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:05.878818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:05.879514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:05.879800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:05.880077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:05.889627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:05.891871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e1445-faa1-4e0e-a65d-b3a585f9cc0c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:05.902027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 739/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:08.343546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2a5b-738d-4fab-8905-8fa70568495b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:08.344229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2a5b-738d-4fab-8905-8fa70568495b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:08.344229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2a5b-738d-4fab-8905-8fa70568495b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:08.345469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 708/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:08.350773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c11ec-c37f-4af0-bf55-0c3dc4857cff None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:08.351227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c11ec-c37f-4af0-bf55-0c3dc4857cff None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:08.351334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c11ec-c37f-4af0-bf55-0c3dc4857cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:08.369354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5d8c11ec-c37f-4af0-bf55-0c3dc4857cff None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:08.370575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5d8c11ec-c37f-4af0-bf55-0c3dc4857cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:08.378834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 740/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:08.416846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2a5b-738d-4fab-8905-8fa70568495b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:08.427992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2a5b-738d-4fab-8905-8fa70568495b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:08.431475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:08.432102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:08.432383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:08.432658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:08.442169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:08.443597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc5fe9-d736-4614-b4a0-f6d9ff91b4bc service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:08.452957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 709/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:10.668383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2a04-bab8-43e6-b31d-a4515a0ce9c2 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:10.668922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2a04-bab8-43e6-b31d-a4515a0ce9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:10.668922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2a04-bab8-43e6-b31d-a4515a0ce9c2 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:10.670396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 741/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:10.675656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371533-c970-4d6a-9011-5b757895fbaa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:10.676078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371533-c970-4d6a-9011-5b757895fbaa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:10.676205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98371533-c970-4d6a-9011-5b757895fbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:10.693912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-98371533-c970-4d6a-9011-5b757895fbaa None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:10.695098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-98371533-c970-4d6a-9011-5b757895fbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:10.703517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 710/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:10.743118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2a04-bab8-43e6-b31d-a4515a0ce9c2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:10.753808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2a04-bab8-43e6-b31d-a4515a0ce9c2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:10.757309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:10.757970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:10.758253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:10.758530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:10.767892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:10.769316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa201e9-f1b4-41a1-a71d-0f5dd578c09e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:10.778613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 742/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:12.865251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9108-56b7-4cab-be10-bdb64c61d8d7 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:12.865850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9108-56b7-4cab-be10-bdb64c61d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:12.865850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f9108-56b7-4cab-be10-bdb64c61d8d7 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:12.867194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 711/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:12.872291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd8704-72ea-4dd2-9e28-531cadaec7dc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:12.873216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd8704-72ea-4dd2-9e28-531cadaec7dc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:12.873551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd8704-72ea-4dd2-9e28-531cadaec7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:12.891653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0ecd8704-72ea-4dd2-9e28-531cadaec7dc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:12.892852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ecd8704-72ea-4dd2-9e28-531cadaec7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:12.900704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 743/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:12.939190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f9108-56b7-4cab-be10-bdb64c61d8d7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:12.949842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f9108-56b7-4cab-be10-bdb64c61d8d7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:12.953345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:12.954010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:12.954324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:12.954571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:12.965453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:12.966961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edc571-9cad-4c3a-8b27-59fc9f49c5ed service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:12.976592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 712/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:15.071009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:15.071547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:15.071547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:15.072939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 744/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:15.078185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282508b-4492-4b11-9469-a6384b5df5b5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:15.078633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282508b-4492-4b11-9469-a6384b5df5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:15.078730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9282508b-4492-4b11-9469-a6384b5df5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:15.096970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9282508b-4492-4b11-9469-a6384b5df5b5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:15.098211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9282508b-4492-4b11-9469-a6384b5df5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:15.106280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 713/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:15.145495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:15.147334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:15.161100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2be29e5-32ac-4c08-b286-29484a22ffac None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:15.164583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:15.165221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:15.165497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:15.165811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:15.174940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:15.176372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123d390-3194-4db7-bb97-8851cdd4ad93 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:15.185933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 745/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:17.332907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7863c-31a1-4b09-8323-b5a5142358b3 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:17.333438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7863c-31a1-4b09-8323-b5a5142358b3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:17.333438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7863c-31a1-4b09-8323-b5a5142358b3 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:17.334923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 714/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:17.340750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d985f9-1929-4e27-9cfd-fb4dd3f9539e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:17.341914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d985f9-1929-4e27-9cfd-fb4dd3f9539e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:17.341914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d985f9-1929-4e27-9cfd-fb4dd3f9539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:17.348033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=70 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:17.362018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e3d985f9-1929-4e27-9cfd-fb4dd3f9539e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:17.367381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e3d985f9-1929-4e27-9cfd-fb4dd3f9539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:17.371232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 746/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:17.409543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7863c-31a1-4b09-8323-b5a5142358b3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:17.415138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=73 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:17.420987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7863c-31a1-4b09-8323-b5a5142358b3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:17.424533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:17.425169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:17.425448 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:17.425746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:17.434679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:17.436134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffaf8a-2760-4542-b9a2-980327200e29 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:17.445826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 715/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:19.551861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447918eb-44b5-44fd-9aaa-7af753d305dc None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:19.552418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447918eb-44b5-44fd-9aaa-7af753d305dc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:19.552418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447918eb-44b5-44fd-9aaa-7af753d305dc None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:19.553836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 747/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:19.559040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefeb-474a-419a-ae5b-aedb866b55c5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:19.559500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefeb-474a-419a-ae5b-aedb866b55c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:19.560124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefeb-474a-419a-ae5b-aedb866b55c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:19.578121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5b4aefeb-474a-419a-ae5b-aedb866b55c5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:19.579303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5b4aefeb-474a-419a-ae5b-aedb866b55c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:19.586997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 716/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:19.625948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447918eb-44b5-44fd-9aaa-7af753d305dc None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:19.636893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447918eb-44b5-44fd-9aaa-7af753d305dc None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:19.640474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:19.641101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:19.641538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:19.641665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:19.650753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:19.652169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b5af2-d3e3-4e35-bc75-790071710f30 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:19.661926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 748/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:21.693882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf69f1-23e0-4a70-b7ad-1e24356ea2ac None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:21.694468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf69f1-23e0-4a70-b7ad-1e24356ea2ac None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:21.694468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf69f1-23e0-4a70-b7ad-1e24356ea2ac None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:21.695815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 717/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:21.700962 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa051-f88a-4c38-87f9-f2778367f947 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:21.701403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa051-f88a-4c38-87f9-f2778367f947 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:21.701510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fa051-f88a-4c38-87f9-f2778367f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:21.719580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7d6fa051-f88a-4c38-87f9-f2778367f947 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:21.720774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7d6fa051-f88a-4c38-87f9-f2778367f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:21.728923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 749/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:21.766017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf69f1-23e0-4a70-b7ad-1e24356ea2ac None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:21.776666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf69f1-23e0-4a70-b7ad-1e24356ea2ac None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:21.780683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:21.781305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:21.781584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:21.781883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:21.790545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:21.791958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9c51c-b3f9-4f1a-b13d-7535a70e25c6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:21.801712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 718/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:23.880930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b754-46b0-4a50-9471-7641f4da749c None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:23.881472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b754-46b0-4a50-9471-7641f4da749c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:23.881472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b754-46b0-4a50-9471-7641f4da749c None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:23.882901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 750/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:23.888907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b359-0c2f-49c1-aa6a-c9aa17b76ccb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:23.889342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b359-0c2f-49c1-aa6a-c9aa17b76ccb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:23.889456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810b359-0c2f-49c1-aa6a-c9aa17b76ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:23.906674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4810b359-0c2f-49c1-aa6a-c9aa17b76ccb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:23.907864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4810b359-0c2f-49c1-aa6a-c9aa17b76ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:23.915502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 719/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:23.952842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b754-46b0-4a50-9471-7641f4da749c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:23.965345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b754-46b0-4a50-9471-7641f4da749c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:23.969361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:23.970051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:23.970331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:23.970609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:23.980649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:23.982159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34436513-fda0-4c42-90c0-228175ab68f9 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:23.992143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 751/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:33.901659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=17 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:33.987459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=17 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:12:43.983875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ed3f-a2fa-40fc-9850-39732a55edbe None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:43.984460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ed3f-a2fa-40fc-9850-39732a55edbe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:43.984460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2ed3f-a2fa-40fc-9850-39732a55edbe None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:43.985856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 720/1471] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:43.991309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c509d17-0653-41a8-9414-2021cc99a037 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:43.991715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c509d17-0653-41a8-9414-2021cc99a037 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:43.991847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c509d17-0653-41a8-9414-2021cc99a037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:44.009573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7c509d17-0653-41a8-9414-2021cc99a037 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:44.010801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7c509d17-0653-41a8-9414-2021cc99a037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:44.018952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 752/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:44.066859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda42d-df4c-4f4e-b7d9-3906cecd878f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:44.067148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda42d-df4c-4f4e-b7d9-3906cecd878f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:44.067427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afda42d-df4c-4f4e-b7d9-3906cecd878f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:44.068814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 721/1473] 10.222.0.65 () {54 vars in 962 bytes} [Fri Jun 24 15:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:44.073540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40da8-79cb-47eb-a9b7-443e7cef1404 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:44.073858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40da8-79cb-47eb-a9b7-443e7cef1404 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:44.074136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc40da8-79cb-47eb-a9b7-443e7cef1404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:44.092291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8cc40da8-79cb-47eb-a9b7-443e7cef1404 None None] MFA Rules not processed for user `53da70e1f5bf46ec924902edf423ca91`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:44.093479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8cc40da8-79cb-47eb-a9b7-443e7cef1404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:44.099865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 753/1474] 10.222.0.65 () {58 vars in 1059 bytes} [Fri Jun 24 15:12:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:44.107821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda42d-df4c-4f4e-b7d9-3906cecd878f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:44.118792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afda42d-df4c-4f4e-b7d9-3906cecd878f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:44.123460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:44.124094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:44.124376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:44.124652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:44.135630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:44.137060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e80531-2687-4e41-aff4-9847e4404e98 service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:44.146617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 722/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:46.273524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc68af-d0dd-4102-aa37-6b1d693df703 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:46.274095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc68af-d0dd-4102-aa37-6b1d693df703 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:46.274095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebc68af-d0dd-4102-aa37-6b1d693df703 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:46.275481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 754/1476] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:46.280627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac63-5504-4eca-9307-38915a86b035 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:46.281173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac63-5504-4eca-9307-38915a86b035 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:46.281173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3ac63-5504-4eca-9307-38915a86b035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:46.299015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f3c3ac63-5504-4eca-9307-38915a86b035 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:46.300212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f3c3ac63-5504-4eca-9307-38915a86b035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:46.307962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 723/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:46.332620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc68af-d0dd-4102-aa37-6b1d693df703 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:46.344987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebc68af-d0dd-4102-aa37-6b1d693df703 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:46.349362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:46.350044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:46.350328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:46.350603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:46.351320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:46.353334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:12:46.353334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:12:46.353334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:12:46.354488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e55813-e616-4f97-ad06-0138c5c95252 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:46.373708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 755/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Fri Jun 24 15:12:46 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:12:48.477059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468982-2fae-4ac0-ab74-253e8e5d3ba5 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:48.477627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468982-2fae-4ac0-ab74-253e8e5d3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:48.477627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81468982-2fae-4ac0-ab74-253e8e5d3ba5 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:48.478913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 724/1479] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:48.484798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a65-041a-4010-aba3-974263523951 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:48.485243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a65-041a-4010-aba3-974263523951 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:48.485356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d6a65-041a-4010-aba3-974263523951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:48.503974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0e0d6a65-041a-4010-aba3-974263523951 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:48.505184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0e0d6a65-041a-4010-aba3-974263523951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:48.513609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 756/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:12:48.556788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81468982-2fae-4ac0-ab74-253e8e5d3ba5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:48.572025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81468982-2fae-4ac0-ab74-253e8e5d3ba5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:48.578118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:48.578751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:48.579033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:48.579308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:48.587720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:48.589285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f657d03-91ac-4fe9-ac5c-08cb832f9fb3 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:48.600737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 725/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:50.834019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366363-d272-4c73-bede-35adf4397cdb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:50.834619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366363-d272-4c73-bede-35adf4397cdb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:50.834619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92366363-d272-4c73-bede-35adf4397cdb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:50.835954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 757/1482] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:50.841710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfce5-01bb-4dfc-9b28-cfe187fadee5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:50.842139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfce5-01bb-4dfc-9b28-cfe187fadee5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:50.842292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfce5-01bb-4dfc-9b28-cfe187fadee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:50.860556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-075dfce5-01bb-4dfc-9b28-cfe187fadee5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:50.861773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-075dfce5-01bb-4dfc-9b28-cfe187fadee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:50.869527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 726/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:50.906758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366363-d272-4c73-bede-35adf4397cdb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:50.918597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92366363-d272-4c73-bede-35adf4397cdb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:50.922235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:50.922867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:50.923149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:50.923426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:50.932479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:50.933973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a491e53-86d4-4067-a587-48ccd208563d service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:50.943306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 758/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:12:53.035852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f24b-4c7a-42aa-9517-0bd1eb09815b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:53.036427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f24b-4c7a-42aa-9517-0bd1eb09815b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:53.036427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f24b-4c7a-42aa-9517-0bd1eb09815b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:53.037839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 727/1485] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:53.043712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b69f-a2c3-48a3-a107-5fb1e6d9a158 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:53.044163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b69f-a2c3-48a3-a107-5fb1e6d9a158 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:53.044273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543b69f-a2c3-48a3-a107-5fb1e6d9a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:53.061967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f543b69f-a2c3-48a3-a107-5fb1e6d9a158 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:53.063173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f543b69f-a2c3-48a3-a107-5fb1e6d9a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:53.071024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 759/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:53.110005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5f24b-4c7a-42aa-9517-0bd1eb09815b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:53.120713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5f24b-4c7a-42aa-9517-0bd1eb09815b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:53.124206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:53.124826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:53.125104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:53.125381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:53.134240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:53.135647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33cea-1004-42f5-8efa-25f0acef1c11 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:53.144917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 728/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:55.410692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f639-da97-4d56-8091-363a6b58375f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:55.411261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f639-da97-4d56-8091-363a6b58375f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:55.411261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea3f639-da97-4d56-8091-363a6b58375f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:55.412636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 760/1488] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:55.418331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc774ee-afef-498b-a838-b9e6803e3347 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:55.418776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc774ee-afef-498b-a838-b9e6803e3347 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:55.418887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc774ee-afef-498b-a838-b9e6803e3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:55.437167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7cc774ee-afef-498b-a838-b9e6803e3347 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:55.438330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7cc774ee-afef-498b-a838-b9e6803e3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:55.446167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 729/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:55.486948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3f639-da97-4d56-8091-363a6b58375f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:55.499279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea3f639-da97-4d56-8091-363a6b58375f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:55.503228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:55.503873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:55.504155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:55.504433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:55.514499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:55.515957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498b8e7-71f8-4558-ae96-dd2024a85591 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:55.525649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 761/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:12:58.188123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a530f-9743-4e25-b6fe-a181b64646b1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:58.188690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a530f-9743-4e25-b6fe-a181b64646b1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:58.188690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a530f-9743-4e25-b6fe-a181b64646b1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:58.190127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 730/1491] 10.222.0.65 () {54 vars in 926 bytes} [Fri Jun 24 15:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:12:58.195403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10986b-3959-4b69-aa0e-df0fd403ec15 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:58.195839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10986b-3959-4b69-aa0e-df0fd403ec15 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:58.195954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10986b-3959-4b69-aa0e-df0fd403ec15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:58.214271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ea10986b-3959-4b69-aa0e-df0fd403ec15 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:12:58.215480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ea10986b-3959-4b69-aa0e-df0fd403ec15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:12:58.223463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 762/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Fri Jun 24 15:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:12:58.263467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a530f-9743-4e25-b6fe-a181b64646b1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:12:58.274143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a530f-9743-4e25-b6fe-a181b64646b1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:12:58.278253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:12:58.278878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:12:58.279158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:12:58.279433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:12:58.288141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:12:58.289555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a218df9a-e5e5-4712-9f0d-bdca96c1a52f service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:12:58.299623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 731/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:13:08.208833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=33 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:13:08.295465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=33 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:14:32.804623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:32.805225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:32.805225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:32.824131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:14:32.825328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:32.833159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 763/1494] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:14:32.841124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:32.841613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:32.841743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:32.860339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:14:32.861540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:32.869243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 732/1495] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:14:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:14:32.874705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:32.884378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22689f4f-8459-4950-b09e-4c41ccfebe7a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:32.889649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:32.890329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:32.890613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:32.890912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:32.891637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:14:32.891938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:32.892950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:32.892950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:14:32.892950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:14:32.893853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:32.905262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 764/1496] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:14:32.913227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:32.922645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d9314-97bd-475e-9ba9-a045b4a7b8fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:32.927198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:32.927837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:32.928113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:32.928378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:32.929070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:32.930852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:32.930852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:14:32.930852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:14:32.932039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.065574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 733/1497] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:14:32 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:14:33.069957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.080646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32199628-160c-48bb-9a3d-f8ba885ffd11 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.135625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.136286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.136558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.136827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.137511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.138549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:33.138549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:14:33.138549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:14:33.139730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.224465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 765/1498] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:14:33 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:14:33.228880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.239859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469bf31-1479-4634-a671-9a31d5409338 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.244470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.245825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.246103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.246373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.247096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.248104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:33.248104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:14:33.248104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:14:33.248986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.261804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 734/1499] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:14:33.265768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.275724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13041500-f86f-4ce4-b781-7db58c005c9b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.280415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.281068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.281349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.281622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.282394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.283406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:33.283406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:14:33.283406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:14:33.284285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e60e65-465b-4199-981d-7508ccb01b09 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.298089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 766/1500] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:14:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:14:33.302385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.313096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a2409-fa46-407b-8ddf-8615898fc509 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.318186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.319004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.319278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.319547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] PATH_INFO: `/v3/projects/c3a3bd77a6a049329511cd0691cb0811/users/55853e399c19462fa7806daffc6a1c6b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.334228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a3bd77a6a049329511cd0691cb0811, user_id=55853e399c19462fa7806daffc6a1c6b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.335253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:33.335253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:14:33.335253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:14:33.337148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9ec46-ac0d-4d1f-ac31-a27991afc9a5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.418486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 735/1501] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:14:33 2022] PUT /identity/v3/projects/c3a3bd77a6a049329511cd0691cb0811/users/55853e399c19462fa7806daffc6a1c6b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:14:33.438115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e50b-911b-46a2-a7fe-95056c05a3d4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.438430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e50b-911b-46a2-a7fe-95056c05a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.438706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6e50b-911b-46a2-a7fe-95056c05a3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.464208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-87c6e50b-911b-46a2-a7fe-95056c05a3d4 None None] MFA Rules not processed for user `55853e399c19462fa7806daffc6a1c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:14:33.465383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-87c6e50b-911b-46a2-a7fe-95056c05a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:33.528687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 767/1502] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:14:33.542374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c508-b507-414e-b7d1-f794bf5b2745 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.542658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c508-b507-414e-b7d1-f794bf5b2745 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.542932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2c508-b507-414e-b7d1-f794bf5b2745 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.544505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 736/1503] 10.222.0.65 () {54 vars in 963 bytes} [Fri Jun 24 15:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:14:33.549285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10748-544d-4a87-9993-add38d1cbff7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.549630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10748-544d-4a87-9993-add38d1cbff7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.549972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea10748-544d-4a87-9993-add38d1cbff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.568097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fea10748-544d-4a87-9993-add38d1cbff7 None None] MFA Rules not processed for user `d167f6076c5745169fede7f865e056da`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:14:33.569366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fea10748-544d-4a87-9993-add38d1cbff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:33.613261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:14:33.620467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 768/1504] 10.222.0.65 () {58 vars in 1060 bytes} [Fri Jun 24 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:14:33.628193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2c508-b507-414e-b7d1-f794bf5b2745 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.639360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2c508-b507-414e-b7d1-f794bf5b2745 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.642881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.643535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.643817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.644092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.652914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.654375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.663279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 737/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:14:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:14:33.704678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4843-803a-4b13-a83f-4de3cfd1db9e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.704960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4843-803a-4b13-a83f-4de3cfd1db9e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.705235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae4843-803a-4b13-a83f-4de3cfd1db9e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.706578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 769/1506] 10.222.0.65 () {52 vars in 829 bytes} [Fri Jun 24 15:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:14:33.710119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:33.771694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8500e5e1-f5b9-4d72-b802-84cc586aca94 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:33.776725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:33.777585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:33.777897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:33.778173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] PATH_INFO: `/v3/users/55853e399c19462fa7806daffc6a1c6b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:33.779377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55853e399c19462fa7806daffc6a1c6b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:33.780407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:33.780407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:14:33.780407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:14:33.781608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:33.950769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55853e399c19462fa7806daffc6a1c6b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:33.969055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55853e399c19462fa7806daffc6a1c6b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.034842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55853e399c19462fa7806daffc6a1c6b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.043955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:14:34.048571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55853e399c19462fa7806daffc6a1c6b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.049013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55853e399c19462fa7806daffc6a1c6b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.054945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 738/1507] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:14:33 2022] DELETE /identity/v3/users/55853e399c19462fa7806daffc6a1c6b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:14:34.059383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:34.059852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:34.060144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:34.077858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:14:34.079045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:34.137097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 770/1508] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:14:34.146592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:34.148714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:34.205078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978d020-3ad9-4a1c-82d4-75c67f3639d6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:34.208699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:34.209347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:34.209630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:34.209941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:34.219068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:34.220505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9992cbb5-9600-4d28-ac16-1452d5b2c2bd service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:34.230410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 739/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:14:34.699878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:14:34.700924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:14:34.713085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b282c5-89ee-464c-8940-ac19f733df4d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:14:34.718067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:14:34.718938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] PATH_INFO: `/v3/projects/c3a3bd77a6a049329511cd0691cb0811` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a3bd77a6a049329511cd0691cb0811)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:14:34.721858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:14:34.723334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:14:34.874911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a3bd77a6a049329511cd0691cb0811', 'request_id': 'req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.888135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a3bd77a6a049329511cd0691cb0811', 'request_id': 'req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.894146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a3bd77a6a049329511cd0691cb0811', 'request_id': 'req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.983867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] The token cache is being invalidate because project c3a3bd77a6a049329511cd0691cb0811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:14:34.984177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.985079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-58ab1e10-fd8d-45d6-b032-7d47486f2ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:14:34.986829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 771/1510] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:14:34 2022] DELETE /identity/v3/projects/c3a3bd77a6a049329511cd0691cb0811 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:14:44.226041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=29 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:14:44.980611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:24.896119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:24.896709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:24.896709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:24.898082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 740/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:24.903059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4902-9888-40e1-85ab-3a9420d134c6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:24.903491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4902-9888-40e1-85ab-3a9420d134c6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:24.903594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a4902-9888-40e1-85ab-3a9420d134c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:24.921981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5d0a4902-9888-40e1-85ab-3a9420d134c6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:24.923175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5d0a4902-9888-40e1-85ab-3a9420d134c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:24.980803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 772/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:25.133989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:25.135719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:25.210997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccc0b0-bb1e-484a-be27-7919e627507f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:25.216292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:25.218516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:25.218516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:25.218516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:25.227052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:25.228623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce933c94-fb45-47d0-ac7f-896c422972e5 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:25.241114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 741/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:26.071548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ed94-516a-4dc3-b65e-e1caaf66542a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:26.072136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ed94-516a-4dc3-b65e-e1caaf66542a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:26.072136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5ed94-516a-4dc3-b65e-e1caaf66542a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:26.073496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 773/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:26.078361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d12aa-f413-4b2c-8fa6-75b93d5b473b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:26.078870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d12aa-f413-4b2c-8fa6-75b93d5b473b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:26.078976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d12aa-f413-4b2c-8fa6-75b93d5b473b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:26.096953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-468d12aa-f413-4b2c-8fa6-75b93d5b473b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:26.098694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-468d12aa-f413-4b2c-8fa6-75b93d5b473b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:26.106683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 742/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:26.260695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ed94-516a-4dc3-b65e-e1caaf66542a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:26.274868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5ed94-516a-4dc3-b65e-e1caaf66542a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:26.280266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:26.280892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:26.281172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:26.281446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:26.290370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:26.291969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583232a8-a65d-4cf2-a6f4-3733ab01d46e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:26.302303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 774/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:26.885429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600475-ef2d-4a6d-acb2-fc5843b904c9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:26.885739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600475-ef2d-4a6d-acb2-fc5843b904c9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:26.886025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600475-ef2d-4a6d-acb2-fc5843b904c9 None None] PATH_INFO: `/v3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:26.887387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 743/1517] 10.222.0.58 () {54 vars in 925 bytes} [Fri Jun 24 15:16:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:16:26.896488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03bd69-186e-41fb-b214-1bb8e6b2e649 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:26.896787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03bd69-186e-41fb-b214-1bb8e6b2e649 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:26.897070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de03bd69-186e-41fb-b214-1bb8e6b2e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:26.915645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-de03bd69-186e-41fb-b214-1bb8e6b2e649 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:26.916862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de03bd69-186e-41fb-b214-1bb8e6b2e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:26.980501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 775/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jun 24 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:36.091587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=37 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:36.186679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acfd-5cc9-4636-aee6-4a3e25857d79 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:36.186911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acfd-5cc9-4636-aee6-4a3e25857d79 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:36.187170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519acfd-5cc9-4636-aee6-4a3e25857d79 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:36.188585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 744/1519] 10.222.0.65 () {54 vars in 960 bytes} [Fri Jun 24 15:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:36.193760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfc85-8bfd-4830-9c52-832e7215f22d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:36.194235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfc85-8bfd-4830-9c52-832e7215f22d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:36.194349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfc85-8bfd-4830-9c52-832e7215f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:36.214478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-973dfc85-8bfd-4830-9c52-832e7215f22d None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:36.215677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-973dfc85-8bfd-4830-9c52-832e7215f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:36.225015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 776/1520] 10.222.0.65 () {58 vars in 1057 bytes} [Fri Jun 24 15:16:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:36.232641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519acfd-5cc9-4636-aee6-4a3e25857d79 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:36.246157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519acfd-5cc9-4636-aee6-4a3e25857d79 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:36.251130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:36.251754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:36.252036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:36.252313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:36.260557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:36.262161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2225dd-091d-4196-af9b-f2e85504733c service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:36.272295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 745/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:37.547344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aa08-169b-4b54-aa1b-67eae8a0263e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:37.547869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aa08-169b-4b54-aa1b-67eae8a0263e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:37.547869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0aa08-169b-4b54-aa1b-67eae8a0263e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:37.549240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 777/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:37.554605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe7822-a11a-40aa-a3ab-fbbba1092727 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:37.555046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe7822-a11a-40aa-a3ab-fbbba1092727 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:37.555152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe7822-a11a-40aa-a3ab-fbbba1092727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:37.575187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a3fe7822-a11a-40aa-a3ab-fbbba1092727 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:37.576386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a3fe7822-a11a-40aa-a3ab-fbbba1092727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:37.584689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 746/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:37.737617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0aa08-169b-4b54-aa1b-67eae8a0263e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:37.752586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0aa08-169b-4b54-aa1b-67eae8a0263e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:37.758604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:37.759264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:37.759544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:37.759818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:37.768036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:37.775323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b4edb-ce84-48e8-b4db-d3d529361322 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:37.779206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 778/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:38.617218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23368d-e218-4219-a19a-fff9c40bc5bb None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:38.617810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23368d-e218-4219-a19a-fff9c40bc5bb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:38.617810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f23368d-e218-4219-a19a-fff9c40bc5bb None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:38.619189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 747/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jun 24 15:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:38.624137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7859c-fc65-4d8e-a12b-b263dff57516 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:38.624598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7859c-fc65-4d8e-a12b-b263dff57516 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:38.624702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7859c-fc65-4d8e-a12b-b263dff57516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:38.642704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5da7859c-fc65-4d8e-a12b-b263dff57516 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:38.643889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5da7859c-fc65-4d8e-a12b-b263dff57516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:38.651601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 779/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jun 24 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:38.803336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23368d-e218-4219-a19a-fff9c40bc5bb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:38.817491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f23368d-e218-4219-a19a-fff9c40bc5bb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:38.822869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:38.823493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:38.823776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:38.824053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:38.832107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:38.833672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24838c4f-462b-4a21-92b1-1ad598455fe9 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:38.843313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 748/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:16:42.956507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:42.957110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:42.957110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:42.958461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 780/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:42.967935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fb1a-4fb7-49da-b546-c0b134550e54 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:42.968467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fb1a-4fb7-49da-b546-c0b134550e54 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:42.968467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895fb1a-4fb7-49da-b546-c0b134550e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:42.987317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0895fb1a-4fb7-49da-b546-c0b134550e54 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:42.988549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0895fb1a-4fb7-49da-b546-c0b134550e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:42.996447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 749/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:16:43.033402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:43.035109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:43.092777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c05e1a-cec4-4d38-b5e4-8acf99c15128 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:43.096323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:43.096963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:43.097246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:43.097525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:43.107148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:43.108566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e182c144-47da-426a-87f4-ae517eda4fd7 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:43.113527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:16:43.118506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 781/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:45.177818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074211b-9532-4228-abc6-46a3a43efb3f None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:45.178389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074211b-9532-4228-abc6-46a3a43efb3f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:45.178389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074211b-9532-4228-abc6-46a3a43efb3f None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:45.179746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 750/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:45.185035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d33b7e-0df8-4cdf-83c9-cfce2a45d158 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:45.185487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d33b7e-0df8-4cdf-83c9-cfce2a45d158 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:45.185600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d33b7e-0df8-4cdf-83c9-cfce2a45d158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:45.203613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-62d33b7e-0df8-4cdf-83c9-cfce2a45d158 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:45.204838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-62d33b7e-0df8-4cdf-83c9-cfce2a45d158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:45.213332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 782/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:45.250048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074211b-9532-4228-abc6-46a3a43efb3f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:45.260951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074211b-9532-4228-abc6-46a3a43efb3f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:45.264442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:45.265063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:45.265341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:45.265610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:45.274985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:45.276388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927dcb4-14cf-45ee-8afe-ad29d39ab0b3 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:45.285574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 751/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:49.008851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:49.009423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:49.009533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:49.011100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 783/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:16:49.016787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b591-1626-4c54-a931-14f8be9a48d3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:49.017286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b591-1626-4c54-a931-14f8be9a48d3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:49.017417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33b591-1626-4c54-a931-14f8be9a48d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:49.035996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ff33b591-1626-4c54-a931-14f8be9a48d3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:49.037192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ff33b591-1626-4c54-a931-14f8be9a48d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:49.045541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 752/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:49.348805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:49.350566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:49.408703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1c83d-4e56-46b8-b379-dad986644b8a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:49.412484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:49.413135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:49.413443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:49.413732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:49.423458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:49.424915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3229bbc-8c6a-42e1-9fcd-730d16ceb6b7 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:49.434799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 784/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:16:51.493172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:51.493697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:51.493697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:51.495277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 753/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jun 24 15:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:16:51.500577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03cbe-b343-42d1-a46d-fe0e840bb914 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:51.501023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03cbe-b343-42d1-a46d-fe0e840bb914 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:51.501121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d03cbe-b343-42d1-a46d-fe0e840bb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:51.519778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-66d03cbe-b343-42d1-a46d-fe0e840bb914 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:16:51.520978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-66d03cbe-b343-42d1-a46d-fe0e840bb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:51.530109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 785/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jun 24 15:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:16:51.834602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:16:51.836276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:16:51.849310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db2c49-434e-4d6d-8fde-cdf1d482f84b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:16:51.852781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:16:51.853403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:16:51.853681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:16:51.853985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:16:51.862726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:16:51.864168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4245ab5-fad8-49b5-b576-c55214798ce6 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:16:51.874238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 754/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:17:01.514598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=32 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:17:01.869913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=33 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:31.151502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fd82-3b4e-47a4-ac3a-577281cffb57 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.178266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fd82-3b4e-47a4-ac3a-577281cffb57 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.178266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fd82-3b4e-47a4-ac3a-577281cffb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.178266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8614fd82-3b4e-47a4-ac3a-577281cffb57 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.178266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8614fd82-3b4e-47a4-ac3a-577281cffb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.190588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 786/1540] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.200173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.213877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.213877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.224096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fead-600f-41ca-9196-767ca0414496 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.229002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fead-600f-41ca-9196-767ca0414496 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.229313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6513fead-600f-41ca-9196-767ca0414496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.243875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.245472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.254961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 755/1541] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.266972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.268494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6513fead-600f-41ca-9196-767ca0414496 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.268494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6513fead-600f-41ca-9196-767ca0414496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.281913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cab21-65ab-4b53-bb09-b4a9c85f4fc7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.282359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 787/1542] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.294030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.294360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.294599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.295283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.295959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.296240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.296514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.297243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:31.297597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.298849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:18:31.298849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:18:31.298849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:18:31.299724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.325132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.326311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 756/1543] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:31.326511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.342449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 788/1544] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.343898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.349564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.359904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea1db1-163e-4fb1-a75f-e43bc6026088 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.368253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af4bb5-81cf-4d11-8a8f-992b3816545d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.374846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.374846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.374846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.374846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.375524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:31.375524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.375524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.398377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.398976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 789/1545] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:18:31.399389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.399714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.399997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.401272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.402737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.407540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.425823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a233eec-9d2f-4e17-83f6-e55b42b846a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.431657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.432332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.432614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.432894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.433868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.443369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:18:31.443369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:18:31.443369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:18:31.444625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.515412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 757/1546] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:31.519639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.548775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 790/1547] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:18:31.555070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.639886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c76e0-32a0-48f0-ace8-99031d1e0263 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.718545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4e97ef-277a-4767-a9a8-169ee987a1f1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.740152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.740857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.741128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.741413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.746536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.748606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511770f1-8b50-4945-8b25-c8f08265eb10 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.788306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.789004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.789281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.789561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.790929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.792113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:18:31.792113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:18:31.792113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:18:31.793354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa179ea5-efca-4cb1-ab68-af0f292de968 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.845551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 791/1548] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/users => generated 293 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:31.847566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d16a-8108-495c-bf50-1c9b8d75dad4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.847995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d16a-8108-495c-bf50-1c9b8d75dad4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.848277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b8d16a-8108-495c-bf50-1c9b8d75dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.872459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e2b8d16a-8108-495c-bf50-1c9b8d75dad4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.873791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e2b8d16a-8108-495c-bf50-1c9b8d75dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.884566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 792/1549] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.889924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.889924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.889924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.908620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.910243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.917754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 758/1550] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/users => generated 293 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:31.919760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 793/1551] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.920003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380149-703a-4306-94b6-93f8d0e87eee None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.920102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380149-703a-4306-94b6-93f8d0e87eee None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.920383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c380149-703a-4306-94b6-93f8d0e87eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.920909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:31.941581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d1920-c375-44d7-9dd9-fbe3c4c8d490 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:31.946578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:31.947250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.947527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.947798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.948522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:31.948649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9c380149-703a-4306-94b6-93f8d0e87eee None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.949836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9c380149-703a-4306-94b6-93f8d0e87eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.950437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19bca3-1a73-404e-8194-53210085080a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:31.961769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 759/1552] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.961769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.961769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.961769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.966646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 794/1553] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:31.969889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2209f0-8bb7-4712-9e90-84549483e880 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:31.969889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2209f0-8bb7-4712-9e90-84549483e880 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:31.969889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2209f0-8bb7-4712-9e90-84549483e880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:31.987502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.988730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.990657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-1d2209f0-8bb7-4712-9e90-84549483e880 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:31.992040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1d2209f0-8bb7-4712-9e90-84549483e880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:31.997381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 760/1554] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:31.998190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.001038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 795/1555] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.002695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122d3-a514-44df-8c53-7c225a55e23c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.002695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122d3-a514-44df-8c53-7c225a55e23c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.002695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34122d3-a514-44df-8c53-7c225a55e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.014558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62755d-021e-4e2e-8153-c7d0407fb96f None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.020019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.020599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b34122d3-a514-44df-8c53-7c225a55e23c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.020733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.020954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.021231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.021885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b34122d3-a514-44df-8c53-7c225a55e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.022080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.023678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de2c922-3dd1-4c08-a0fd-3914f0419d27 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.029828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 796/1556] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.031071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.031340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.031617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.037004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 761/1557] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:32.037004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924ddc6-70d7-4383-afd2-869343600ac6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.037004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924ddc6-70d7-4383-afd2-869343600ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.037004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0924ddc6-70d7-4383-afd2-869343600ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.054904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.056754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.059483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0924ddc6-70d7-4383-afd2-869343600ac6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.060671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0924ddc6-70d7-4383-afd2-869343600ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.064854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 797/1558] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.065689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.072374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 762/1559] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.073662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.073981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.074254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.078356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa14d1-15a5-4787-aaca-578aec5fca94 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.084552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.085249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.085525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.085843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.087695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.089355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab8336-98ab-47a5-aacc-dfc209e4019e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.092704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.093936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.100330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 798/1560] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:32.101564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.101881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.102163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.105550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 763/1561] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.106564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.119339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e682c9f-adce-412b-9970-a37b9e730bd7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.121089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.122325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.124058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.124713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.124991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.125262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.126051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.126438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.128249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a134-203d-491c-a00d-a7775e709ee0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.130654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 799/1562] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.131561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.141002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add850-5ee5-49c0-89ad-5473200fa9af None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.144243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 764/1563] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.145504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.145815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.146090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.153161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.153984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.154143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:32.154475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.154759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.155501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.157136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.164161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.179992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.180135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 800/1564] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:32.180135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.180414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 765/1565] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.180414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.180608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c95f58-ab91-4419-8b78-81b67e90b821 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.186054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bef469f-ab1c-4300-97bd-255cb3cd46e7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.188409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.189076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.189356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.189668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.190395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.190797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.190912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.191612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.191898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.192178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.192286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.192908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.193219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.194861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994e456-d7be-4ee4-be59-322823fb6f5b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.205303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 801/1566] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.206163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.209310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 766/1567] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.210753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.214196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.214196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.218300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd7a2-df8c-4222-b677-4f9a44d35fe5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.224006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.224834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.226040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.226040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] PATH_INFO: `/v3/projects/e9fd02f6311546dd9be6735c36c1d404/users/c3659551bf7149dab52b041609469885/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.229593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:32.237959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.239205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.241520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9fd02f6311546dd9be6735c36c1d404, user_id=c3659551bf7149dab52b041609469885, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.242626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:18:32.242626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:18:32.242626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:18:32.244642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.247060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 767/1568] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.247959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.257275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10572630-98ff-4a24-a504-4651d2d7edc9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.261909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.263152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.263152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.263152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.263780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.264081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.265677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.277879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 768/1569] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.278734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.287984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384432e-4536-44f7-91d2-f97ae9350059 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.293017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.293638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.293942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.294212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.294873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.296728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.364663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 802/1570] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:32 2022] PUT /identity/v3/projects/e9fd02f6311546dd9be6735c36c1d404/users/c3659551bf7149dab52b041609469885/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:32.365638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.391847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 769/1571] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:32.393216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.431739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8e67d-7984-4461-a4da-3abb5e6e5b97 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.457149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc5098-bfe2-41ec-9127-52fd8df005f8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.462701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.463362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.463764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.464049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.464772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.465085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.466731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.481849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 770/1572] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.481849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.490987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57d5bc-e963-4e51-b6fb-e78e5e174973 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.495484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.500042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.500042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.500042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.500345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.500456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.500551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.500551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.500551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] PATH_INFO: `/v3/projects/8e5fdee9d9f042ba9dde6c3c781bb2fc/users/b7c7538bc2bb4906932e73b56d71e69c/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.500831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.514782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5fdee9d9f042ba9dde6c3c781bb2fc, user_id=b7c7538bc2bb4906932e73b56d71e69c, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.517584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.594206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 771/1573] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:32.595030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.617017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 803/1574] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:32 2022] PUT /identity/v3/projects/8e5fdee9d9f042ba9dde6c3c781bb2fc/users/b7c7538bc2bb4906932e73b56d71e69c/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:32.617910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.658802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac11eb5-8ad7-4a53-ad51-40fb45901f4c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.677518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:32.682323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b9214-cdba-4931-9fa0-dbd72c9410fc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.687408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.689151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.689151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.689151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.689447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:32.689674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.691362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.703960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 804/1575] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:32.704854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.715621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ae1ee0-feca-45bc-892e-c26639d73be4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.720937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.721628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.724273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.724273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.724273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.724579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.724579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.724579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.724579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.724949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b48fa33-9db8-4667-b802-ccb190b801c1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.725620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.727529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.729085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:32.827602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 805/1576] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:32.827602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.827602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.827602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.852946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] MFA Rules not processed for user `c3659551bf7149dab52b041609469885`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:32.854206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:32.864478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 772/1577] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:32.874787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.924337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 806/1578] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:32.925282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:32.930158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130d3a3-6524-46e8-9cfe-b1f4a6c01fe3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.936719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.954901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.954901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.954901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.954901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.954901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:32.988167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f32b0-8831-44f4-a138-d24ca16065d5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:32.992643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:32.993846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:32.994137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:32.994413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:32.995095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:32.997040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4977e3-881d-40f5-9f20-e542165ec768 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.055193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 773/1579] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.056635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.066585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62d667-f7f3-4eb2-be14-b7dcc1c28b42 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.071390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.073091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.073091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.073346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.073910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.075849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.086733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 807/1580] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:32 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.087502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.087791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.088071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.105161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:33.106392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:33.165732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 808/1581] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:33.166701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.171491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:33.176640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15eb844-dfcc-49fb-ace8-e2306301a9e4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.181862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.182537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.182819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.183092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.183768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.185646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.205349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 774/1582] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.206213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.216680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a998bf9-873d-4ade-9299-2c3144a109cd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.223747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.224421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.224700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.224971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.225805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.228120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f521fe2-4d88-4150-80a7-e2bd3b318b3c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.278362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 809/1583] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.279181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.340770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad21c6-ade9-462d-895c-29dcf0511956 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.343788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 775/1584] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.345115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b96ee-4fc0-41fd-ace2-78794eb80745 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.345401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b96ee-4fc0-41fd-ace2-78794eb80745 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.345673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b96ee-4fc0-41fd-ace2-78794eb80745 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.347097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 776/1585] 10.222.0.65 () {54 vars in 961 bytes} [Fri Jun 24 15:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:33.348828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.349532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.349854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.350150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.350870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.352085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b96ee-4fc0-41fd-ace2-78794eb80745 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.353354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.366105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b96ee-4fc0-41fd-ace2-78794eb80745 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.373645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.374359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.374633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.374906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.375666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.377292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.387740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 777/1586] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.391597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.398057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d418e9-31b4-44c8-8ea2-56a7ae6f032b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.402597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.403238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.403510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.403778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.404443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.406383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.445480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 810/1587] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.446533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.500867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68fc48-2d1c-4fb9-99fb-2ee6ff09916b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.505883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.506828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.506964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 778/1588] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/users => generated 296 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.507054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.507224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.507593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.517646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c64a2d-2bd7-4eb3-9509-92bae5f2136d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.518515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.519956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.522729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.523395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.523746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.524027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.524754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.526387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.530189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 811/1589] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:33.531096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.541555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 779/1590] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.541555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.544495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23959f39-61fb-437f-97cf-d96df9ed8afd service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.549438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.550312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.550564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.550669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2dca31-398d-4089-a6e5-16d3f224051f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.550770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.551403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.553406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.555628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.556939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.557201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.557478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.558242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.559836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad93b90-576c-4342-a145-c1ac707404bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.570653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 780/1591] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.571941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.572227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.572505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.591612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:33.592793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:33.598288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:33.663774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 781/1592] 10.222.0.65 () {58 vars in 1058 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:33.664066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 812/1593] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:33 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:33.665065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.665270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.676961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9f053-b25f-4003-92d8-173a8c513be9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.682438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.683360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.683651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.683833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6236d-44ca-404b-829c-01eb5eb3f2a0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.684024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.684753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.686667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.690307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.691209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.691630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.692031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.693216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.695371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.700046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 813/1594] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.700974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.712768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee80fee5-8e4a-48c1-a234-e6abb27d101d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.715753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 782/1595] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.716803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.722138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.722871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.723154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.723437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.724428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.726081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.731142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e15c9-4af5-498a-80a3-35e4cd55ffd4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.737072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.737988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.738375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.738601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 814/1596] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.738853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.739566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.740021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.742239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.750121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ef41a-5cdc-4d2a-81ae-17d18a1830fd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.754875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 783/1597] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.759015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.759015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.759015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.759015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.759422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.759540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.759540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.767773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf9b8d-14a2-45dc-b787-b4dbfd5aaa1f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.769503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 815/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.770422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.772506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.773193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.773478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.773777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.774503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.776591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.783715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b502334d-ec25-4c34-a4f4-2ad679f356a4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.787967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 784/1599] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.788786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.792388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.793113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.793462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.793769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.799327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7eb131-a1b4-42b7-b8d6-84c6d0e543b2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.807229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.809455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.810606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.810966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.812174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.815091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.819319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:33.832778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 785/1600] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.832778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.847587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf99ca3-80ac-4cad-a2bf-c8b62f5d7d0a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.854537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.855679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.855874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.856154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] PATH_INFO: `/v3/projects/5dbbcd08bfdb4af6b68a2e21f3207eb7/users/98f6cddbd00a43529d37fd159f969d73/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.861290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.869445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.881674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 816/1601] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:33.883400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.888931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dbbcd08bfdb4af6b68a2e21f3207eb7, user_id=98f6cddbd00a43529d37fd159f969d73, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.894441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.903078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae38cb0-5e41-4a7a-b803-38a1ea81550e service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.907919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.908619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.908905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.909217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.909980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.911636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.927874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 817/1602] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:33.927874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:33.938229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce5990-7043-46ce-b8ac-7c81f611436d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:33.943529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:33.944412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:33.944687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:33.944960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] PATH_INFO: `/v3/projects/7fa4bf3881fe494db870e0f220a34824/users/d86ae885b5184169b0f7742acd58f08e/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:33.960359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa4bf3881fe494db870e0f220a34824, user_id=d86ae885b5184169b0f7742acd58f08e, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:33.964042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:33.982354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 786/1603] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:33 2022] PUT /identity/v3/projects/5dbbcd08bfdb4af6b68a2e21f3207eb7/users/98f6cddbd00a43529d37fd159f969d73/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:33.986103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.052100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da88149-0c51-4c3d-b38c-fb24947b3164 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.058538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.061529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.061939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.062290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] PATH_INFO: `/v3/projects/cf030b31edef4f47bbff5cf2f9e1eaf4/users/77069a1606e04716971b04b34f0dcd9d/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.074234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 818/1604] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:33 2022] PUT /identity/v3/projects/7fa4bf3881fe494db870e0f220a34824/users/d86ae885b5184169b0f7742acd58f08e/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:34.075672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.086513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf030b31edef4f47bbff5cf2f9e1eaf4, user_id=77069a1606e04716971b04b34f0dcd9d, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.090545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.158991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2029e45-5fb0-456a-a1bb-455c3816eabd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.163638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.164301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.164578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.164848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.166384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.167765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.178608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 819/1605] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:34.179426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.188828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 787/1606] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:33 2022] PUT /identity/v3/projects/cf030b31edef4f47bbff5cf2f9e1eaf4/users/77069a1606e04716971b04b34f0dcd9d/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:34.192362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.192528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d9e4-fe42-4d58-993a-e6ed582701c2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.212553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:34.258375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b65283-1027-413f-9911-245efe3d35e4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.260350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.261258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.261534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.261903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] PATH_INFO: `/v3/projects/1e2b52f8f284478d96c34a613dbec8eb/users/8dd9bbd11fd74ed1963cc0ecc84d643b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.264751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.266424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.266711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.266982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] PATH_INFO: `/v3/projects/d91120f45ad3454c94e1438788253cf3/users/a7c271c1c0014af0bfc280e36135ce20/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.279555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2b52f8f284478d96c34a613dbec8eb, user_id=8dd9bbd11fd74ed1963cc0ecc84d643b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.282563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefd09-11dc-4612-aa4b-39791fc64801 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.283069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d91120f45ad3454c94e1438788253cf3, user_id=a7c271c1c0014af0bfc280e36135ce20, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.285853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a91a9-c6d9-4411-96ce-31990077bbd1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.366823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 820/1607] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:34 2022] PUT /identity/v3/projects/1e2b52f8f284478d96c34a613dbec8eb/users/8dd9bbd11fd74ed1963cc0ecc84d643b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:34.368931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56442-7ee3-4a86-84c2-b78d3eeef14c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.369414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56442-7ee3-4a86-84c2-b78d3eeef14c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.370124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef56442-7ee3-4a86-84c2-b78d3eeef14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.377896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:34.400034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5ef56442-7ee3-4a86-84c2-b78d3eeef14c None None] MFA Rules not processed for user `98f6cddbd00a43529d37fd159f969d73`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.401302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5ef56442-7ee3-4a86-84c2-b78d3eeef14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.426846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 788/1608] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:34 2022] PUT /identity/v3/projects/d91120f45ad3454c94e1438788253cf3/users/a7c271c1c0014af0bfc280e36135ce20/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:34.428947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c41be-6532-42b4-ab86-e8bc46b29ac7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.429377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c41be-6532-42b4-ab86-e8bc46b29ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.430029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c41be-6532-42b4-ab86-e8bc46b29ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.450567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-224c41be-6532-42b4-ab86-e8bc46b29ac7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.451786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-224c41be-6532-42b4-ab86-e8bc46b29ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.492684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 821/1609] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.494820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a71c-ab34-4a60-bf9a-70ec85d5c338 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.494966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a71c-ab34-4a60-bf9a-70ec85d5c338 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.495238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8a71c-ab34-4a60-bf9a-70ec85d5c338 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.496958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 822/1610] 10.222.0.65 () {54 vars in 912 bytes} [Fri Jun 24 15:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:34.497654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a71c-ab34-4a60-bf9a-70ec85d5c338 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.517001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 789/1611] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.518486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b439-5a13-45c2-a1b4-27229d3c92ef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.518847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b439-5a13-45c2-a1b4-27229d3c92ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.519189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9b439-5a13-45c2-a1b4-27229d3c92ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.553426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aba9b439-5a13-45c2-a1b4-27229d3c92ef None None] MFA Rules not processed for user `77069a1606e04716971b04b34f0dcd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.554561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aba9b439-5a13-45c2-a1b4-27229d3c92ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.568437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8a71c-ab34-4a60-bf9a-70ec85d5c338 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.574386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.575675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.575958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.576237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] PATH_INFO: `/v3/projects/a9d41711e9f54435a9f5c5eb8906c9ff/users/c42165e400c247aba309d3c7a370f476/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.596959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9d41711e9f54435a9f5c5eb8906c9ff, user_id=c42165e400c247aba309d3c7a370f476, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.601534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.628468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 790/1612] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.629843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb71e3-bf4b-455d-8e5c-7ba1fa6f7950 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.630131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb71e3-bf4b-455d-8e5c-7ba1fa6f7950 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.630556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bb71e3-bf4b-455d-8e5c-7ba1fa6f7950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.648466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-81bb71e3-bf4b-455d-8e5c-7ba1fa6f7950 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.649774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-81bb71e3-bf4b-455d-8e5c-7ba1fa6f7950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.657595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 791/1613] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.658833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925df2-dd2d-4061-bb39-f3ecfc490a7c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.659117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925df2-dd2d-4061-bb39-f3ecfc490a7c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.659395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99925df2-dd2d-4061-bb39-f3ecfc490a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.677682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-99925df2-dd2d-4061-bb39-f3ecfc490a7c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.679030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-99925df2-dd2d-4061-bb39-f3ecfc490a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.686491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 823/1614] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:34 2022] PUT /identity/v3/projects/a9d41711e9f54435a9f5c5eb8906c9ff/users/c42165e400c247aba309d3c7a370f476/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:34.687303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.703446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:34.747468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 792/1615] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.749048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.749414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.749822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.770011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:34.771337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:34.779311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b0bd4-d5c5-405e-b2b9-b535dee7deeb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.785379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:34.786470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:34.787168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:34.787735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:34.788945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:34.792027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:34.862640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 793/1616] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:34.863655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.910814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 824/1617] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/projects => generated 363 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:34.912361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:34.919055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:34.939507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6596d25a-e1d4-4667-abba-d58cc1917f27 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:34.993024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db102c0-2271-41c5-aec0-08816aa15c13 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.000266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.001433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.002001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.002569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.003465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.006200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.017212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.018872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.019164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.019446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.031601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.033081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.045112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 794/1618] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:35.045921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.054826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8aa72e-72ce-446c-8e82-05ad0d8e6943 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.059388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.060094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.060431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.060707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.071900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.073090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3e950-44bd-45b8-a2cb-a7b64fbee0e5 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.084621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 795/1619] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:35.085982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.093960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.093960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.093960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.106997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:35.108231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:35.116272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 796/1620] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:35.120510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.126497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3978d-9b1f-4c86-afc2-90f36a3cc7eb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.130511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.139913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.139913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.139913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.141439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.142946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.154428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 797/1621] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:35.155277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.168521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 825/1622] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:34 2022] POST /identity/v3/projects => generated 387 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:35.175279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.231012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4081502c-f94f-4cc2-bf12-85576221fc69 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.246030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce5e7c-05d0-4f85-a17a-90394d94c94f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.251016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.251986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.252274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.252557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.253445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.256006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.286985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.288461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.288911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.289353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.362565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 826/1623] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:35 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:35.363708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.367688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:35.422471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.424843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.444692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 798/1624] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:35.449967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.466618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d04567-673a-47de-8bb1-caca0cbe06b2 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.474374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.474948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.475237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.475789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.476601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.479642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.508318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aed9-7c32-4684-9212-64beee1896bd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.521509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.522945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.524091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.525800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.539136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.540837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.552346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 827/1625] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:35.553281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.564074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d651e51d-1838-462a-bcd9-0b9e798e93fd service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.574161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.575013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.575557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.575929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.576765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.578726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.597806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 828/1626] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:35.598942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.621413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 799/1627] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:35 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:35.621849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccd944-1b4b-4674-8007-1fc1448fa1cd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.624121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.637016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.642036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.642389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.642785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] PATH_INFO: `/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85/users/4e48dfbc0e2047758356f9e8a8527e90/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.645803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf15c43-2094-4af5-b1d2-d479f53f0aec admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.651894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.662851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.665281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.665631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.666002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.667425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.672322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.684183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ab1370eeb342c4b65b29aa98dbcc85, user_id=4e48dfbc0e2047758356f9e8a8527e90, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.691234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.697768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 800/1628] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:18:35.701188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.715277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9400da-92dd-415d-a3e4-d9927d4aac93 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.722357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:35.723550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:35.724021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:35.724489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] PATH_INFO: `/v3/projects/f967806805e4469a93926d5ab7a6291f/users/dcd138d62b1f44e7818e40b966311e45/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:35.735395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:35.761169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f967806805e4469a93926d5ab7a6291f, user_id=dcd138d62b1f44e7818e40b966311e45, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:35.766459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:35.780967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 829/1629] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:35 2022] PUT /identity/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85/users/4e48dfbc0e2047758356f9e8a8527e90/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:35.784742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.867087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 801/1630] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:35 2022] PUT /identity/v3/projects/f967806805e4469a93926d5ab7a6291f/users/dcd138d62b1f44e7818e40b966311e45/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:35.868905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:35.901803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4ce12-8408-4fa3-ac3d-66684baa647d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:35.995224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244b6ef-a1d2-4ff3-b4f6-35a5271a3c5c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:36.001439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.002173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.002609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.002893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.003640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.005892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.008692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.010669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.015829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.020604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.020604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.020604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.045028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 802/1631] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:36.045431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 830/1632] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:36.048957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:36.062889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:36.079950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae7986d-bfd6-44c9-8b7a-44928806bcef admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:36.081736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d5dbf-d405-46e6-ba93-893acc51b9a7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:36.090227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.091443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.091871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.092249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] PATH_INFO: `/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85/users/4e48dfbc0e2047758356f9e8a8527e90/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.096603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ab1370eeb342c4b65b29aa98dbcc85, user_id=4e48dfbc0e2047758356f9e8a8527e90, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.101129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.102104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.102390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.103276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] PATH_INFO: `/v3/projects/f967806805e4469a93926d5ab7a6291f/users/dcd138d62b1f44e7818e40b966311e45/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.107261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e25a3a-aef0-4b8c-937c-707cedcbf51a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.109800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f967806805e4469a93926d5ab7a6291f, user_id=dcd138d62b1f44e7818e40b966311e45, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.114433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80d90e-4bd2-45f3-8669-c91eb534afac admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.135042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 831/1633] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:36 2022] PUT /identity/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85/users/4e48dfbc0e2047758356f9e8a8527e90/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:36.138629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.153596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 803/1634] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:36 2022] PUT /identity/v3/projects/f967806805e4469a93926d5ab7a6291f/users/dcd138d62b1f44e7818e40b966311e45/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:36.154671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.154671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.154913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.155271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.155812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.203235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] MFA Rules not processed for user `4e48dfbc0e2047758356f9e8a8527e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:36.207521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:36.217852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] MFA Rules not processed for user `dcd138d62b1f44e7818e40b966311e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:36.219384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:36.370978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:36.370978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 832/1635] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:36 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:36.370978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:36.390958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 804/1636] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:36.486021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a279ca-6e0c-48db-ba5c-8f16da15c89b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:36.507279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.509452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.509638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.511293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.522471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.523990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.540580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 833/1637] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:36 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:18:36.741049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:36.756773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a7bdf-1b9d-44d6-8177-0f4848791846 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:36.764970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:36.765944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:36.769780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:36.769780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:36.779239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:36.783798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f86fe4-eced-4b17-baea-1c64ad07af36 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:36.810701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 805/1638] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:36.836841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:37.012414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d91de9-77e3-4107-83c5-f8ef3c99381f service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:37.018182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:37.019640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.019640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.019837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] PATH_INFO: `/v3/users/77069a1606e04716971b04b34f0dcd9d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.021258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77069a1606e04716971b04b34f0dcd9d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:37.022243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: WARNING py.warnings [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:18:37.022243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: warnings.warn(msg) Jun 24 15:18:37.022243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: Jun 24 15:18:37.023592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:37.376423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f78f-b838-482e-b1ce-8b393040b04d None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.377090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f78f-b838-482e-b1ce-8b393040b04d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.377419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5f78f-b838-482e-b1ce-8b393040b04d None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.380309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 806/1639] 10.222.0.65 () {54 vars in 961 bytes} [Fri Jun 24 15:18:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:37.388766 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2aef-c870-4f6b-91ae-68823ee77b74 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.389693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2aef-c870-4f6b-91ae-68823ee77b74 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.390089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e2aef-c870-4f6b-91ae-68823ee77b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.417619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-271e2aef-c870-4f6b-91ae-68823ee77b74 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:37.419000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-271e2aef-c870-4f6b-91ae-68823ee77b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:37.478127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:37.520116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 807/1640] 10.222.0.65 () {58 vars in 1058 bytes} [Fri Jun 24 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:18:37.525506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41616-225e-4021-86cd-605d348c7b11 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.525986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41616-225e-4021-86cd-605d348c7b11 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.526369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed41616-225e-4021-86cd-605d348c7b11 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.528387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 808/1641] 10.222.0.65 () {54 vars in 912 bytes} [Fri Jun 24 15:18:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 24 15:18:37.533897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.534331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.535322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.567288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:37.568448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77069a1606e04716971b04b34f0dcd9d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:37.568947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:37.583951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 809/1642] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:37.597455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:37.608051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77069a1606e04716971b04b34f0dcd9d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:37.612825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe35b71-a9a3-4e24-9853-706a31268b3a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:37.621806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:37.622564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.622994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.623370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.645120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:37.648336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395df4d2-874e-4f63-8f5c-1b4d28385265 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:37.681396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 810/1643] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:37.695366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77069a1606e04716971b04b34f0dcd9d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:37.696359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77069a1606e04716971b04b34f0dcd9d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:37.716908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77069a1606e04716971b04b34f0dcd9d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:37.730430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 834/1644] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:36 2022] DELETE /identity/v3/users/77069a1606e04716971b04b34f0dcd9d => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:37.738029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:37.738029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:37.738029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:37.766854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:37.769318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:37.900797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 811/1645] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:37.912627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:37.918928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:37.971267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:38.050911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe668f2f-d508-4ddc-8e31-e76d871a634e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:38.054554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:38.055290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:38.055706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:38.056556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:38.451315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:38.451315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206aad6-d791-4b5a-80df-5df884534a9c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:38.451315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 835/1646] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:18:38.663747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:38.665353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:38.678737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be5dbf-4846-43f6-81fc-fd2c8dc7d729 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:38.685464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:38.686301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:38.686720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:38.687050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] PATH_INFO: `/v3/users/98f6cddbd00a43529d37fd159f969d73` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:38.689701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f6cddbd00a43529d37fd159f969d73)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:38.694349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:38.942085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f6cddbd00a43529d37fd159f969d73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:38.969830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f6cddbd00a43529d37fd159f969d73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:39.106278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f6cddbd00a43529d37fd159f969d73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:39.118516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f6cddbd00a43529d37fd159f969d73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:39.119551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f6cddbd00a43529d37fd159f969d73'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:39.136067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 812/1647] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:38 2022] DELETE /identity/v3/users/98f6cddbd00a43529d37fd159f969d73 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:39.136259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:39.136710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:39.137042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:39.167849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:39.169402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:39.256270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 836/1648] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:18:39.296494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:39.298073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:39.361937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:39.397896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-4b28-4bba-94f8-cfcc60c3ac8c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:39.403218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:39.404113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:39.405145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:39.405565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:39.418958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:39.421134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:39.442429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 813/1649] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:39.891081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:39.893555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:39.926075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89bdf4d-75e1-4868-9f4e-fb0790da282e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:39.935392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:39.936452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:39.936891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:39.937310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] PATH_INFO: `/v3/projects/cf030b31edef4f47bbff5cf2f9e1eaf4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:39.939454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf030b31edef4f47bbff5cf2f9e1eaf4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:39.941570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:40.109032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf030b31edef4f47bbff5cf2f9e1eaf4', 'request_id': 'req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.124036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf030b31edef4f47bbff5cf2f9e1eaf4', 'request_id': 'req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.140175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf030b31edef4f47bbff5cf2f9e1eaf4', 'request_id': 'req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.233860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] The token cache is being invalidate because project cf030b31edef4f47bbff5cf2f9e1eaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:18:40.234509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.235433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.237521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 837/1650] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:18:39 2022] DELETE /identity/v3/projects/cf030b31edef4f47bbff5cf2f9e1eaf4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:40.241691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:40.264685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f04632-3129-4717-9c9e-dea5dc5bed02 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:40.416037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:40.416924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:40.417204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:40.417518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] PATH_INFO: `/v3/users/dcd138d62b1f44e7818e40b966311e45` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:40.418789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd138d62b1f44e7818e40b966311e45)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:40.420727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:40.736381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd138d62b1f44e7818e40b966311e45'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.762232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd138d62b1f44e7818e40b966311e45'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.833477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd138d62b1f44e7818e40b966311e45'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.842777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd138d62b1f44e7818e40b966311e45'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.845364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd138d62b1f44e7818e40b966311e45'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:40.873918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 814/1651] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:40 2022] DELETE /identity/v3/users/dcd138d62b1f44e7818e40b966311e45 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:41.156525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:41.158033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:41.178621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa319d2c-1734-4ccc-a551-4d3500a3fbe7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:41.273543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:41.290409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:41.291761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:41.292189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:41.292606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] PATH_INFO: `/v3/projects/5dbbcd08bfdb4af6b68a2e21f3207eb7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:41.294059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dbbcd08bfdb4af6b68a2e21f3207eb7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:41.296526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:41.503252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dbbcd08bfdb4af6b68a2e21f3207eb7', 'request_id': 'req-b9aff1ae-c398-454d-a6a5-ea91fc509352'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:41.519179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dbbcd08bfdb4af6b68a2e21f3207eb7', 'request_id': 'req-b9aff1ae-c398-454d-a6a5-ea91fc509352'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:41.530545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dbbcd08bfdb4af6b68a2e21f3207eb7', 'request_id': 'req-b9aff1ae-c398-454d-a6a5-ea91fc509352'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:41.669228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] The token cache is being invalidate because project 5dbbcd08bfdb4af6b68a2e21f3207eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:18:41.670029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:41.670879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:41.674031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 838/1652] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:18:41 2022] DELETE /identity/v3/projects/5dbbcd08bfdb4af6b68a2e21f3207eb7 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:41.679366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:41.681856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:41.712516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31a154-3d47-46ba-a4d6-ce733c9a26b3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:41.921820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:41.951241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:41.952677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:41.953259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:41.953678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] PATH_INFO: `/v3/users/4e48dfbc0e2047758356f9e8a8527e90` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:41.957902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e48dfbc0e2047758356f9e8a8527e90)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:41.965066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:42.257933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e48dfbc0e2047758356f9e8a8527e90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:42.332360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e48dfbc0e2047758356f9e8a8527e90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:42.464923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e48dfbc0e2047758356f9e8a8527e90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:42.481683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e48dfbc0e2047758356f9e8a8527e90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:42.482603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ba629eeb-1a04-4270-83b4-0cb8fdd7d6ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e48dfbc0e2047758356f9e8a8527e90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:42.504083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 815/1653] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:41 2022] DELETE /identity/v3/users/4e48dfbc0e2047758356f9e8a8527e90 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:42.980606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:42.982195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:43.009538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff1ae-c398-454d-a6a5-ea91fc509352 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:43.172516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:43.174660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:43.175264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:43.175689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] PATH_INFO: `/v3/projects/f967806805e4469a93926d5ab7a6291f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:43.179885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f967806805e4469a93926d5ab7a6291f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:43.182853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:43.369471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f967806805e4469a93926d5ab7a6291f', 'request_id': 'req-a620e8bc-1d94-475c-970e-f9e7ebbb362c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:43.408762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f967806805e4469a93926d5ab7a6291f', 'request_id': 'req-a620e8bc-1d94-475c-970e-f9e7ebbb362c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:43.426691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f967806805e4469a93926d5ab7a6291f', 'request_id': 'req-a620e8bc-1d94-475c-970e-f9e7ebbb362c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:43.566437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] The token cache is being invalidate because project f967806805e4469a93926d5ab7a6291f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:18:43.568968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:43.568968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a620e8bc-1d94-475c-970e-f9e7ebbb362c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:43.575192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 839/1654] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:18:42 2022] DELETE /identity/v3/projects/f967806805e4469a93926d5ab7a6291f => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:43.577460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:43.583792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:43.589037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:43.643920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:43.643920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:43.854932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 816/1655] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:43.862387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:43.862612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:43.862935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:43.898138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:43.900372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:43.923994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 840/1656] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:43.929049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:43.948809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed856bf6-359c-4005-84f4-8b1d9f497376 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:43.955405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:43.957066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:43.957608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:43.958590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:43.959701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:43.960125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:43.970996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.000447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 817/1657] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:44.002327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.007707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:44.016695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950f26-6f6d-4b63-bfb9-e88a3c82df06 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.026622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:44.030130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.030702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.031282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:44.032320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:44.039088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.222837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 841/1658] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:44 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:44.226980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.242230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfafe5-aea4-48f5-bc26-91cb3a3bb7e0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.352880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:44.361919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:44.362676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.362963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.363239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:44.364026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:44.366254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.510668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.513538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:44.516497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 818/1659] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:44 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:18:44.519820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.540764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddea49c-6e8c-4821-a5c6-5ba0c01fef5e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.554415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:44.555471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.558788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.559178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] PATH_INFO: `/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:44.560679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ab1370eeb342c4b65b29aa98dbcc85)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:44.565705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.585994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e89a8-c62b-44c4-9cd4-9c2d651e8049 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.611938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:44.612630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.612912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.613184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:44.619474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:44.626684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.690866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 819/1660] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:44.697245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.733282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cb6ea-28b3-4321-aa7f-baf0cffb9815 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.748763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:44.749878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.750311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.750731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:44.751604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:44.754935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:44.781531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 820/1661] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:44.785858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:44.802186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ab1370eeb342c4b65b29aa98dbcc85', 'request_id': 'req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:44.815840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543beb5-951c-40e6-aba0-30129db50f4e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:44.816120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ab1370eeb342c4b65b29aa98dbcc85', 'request_id': 'req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:44.841281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ab1370eeb342c4b65b29aa98dbcc85', 'request_id': 'req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:44.949045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] The token cache is being invalidate because project e5ab1370eeb342c4b65b29aa98dbcc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:18:44.949045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:44.949045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6cd3d9bb-8b5b-48e3-8982-ad23887b3858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:44.949045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 842/1662] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:18:44 2022] DELETE /identity/v3/projects/e5ab1370eeb342c4b65b29aa98dbcc85 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:44.977243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06ee9-e213-44ab-912c-25efe9fbf9b7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:44.995903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06ee9-e213-44ab-912c-25efe9fbf9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:44.995903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06ee9-e213-44ab-912c-25efe9fbf9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.007656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:45.014300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.014579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.014872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] PATH_INFO: `/v3/projects/d1614aeb6d484886a1bdd6f3a55881da/users/3fedd4d0089e4b2288f662c9a13a79bd/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.066904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1614aeb6d484886a1bdd6f3a55881da, user_id=3fedd4d0089e4b2288f662c9a13a79bd, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:45.069500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:45.088689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6ab06ee9-e213-44ab-912c-25efe9fbf9b7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:45.091261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ab06ee9-e213-44ab-912c-25efe9fbf9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:45.111057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 843/1663] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:45.119181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a003-5ca0-4684-be5e-756f833a6d88 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.119728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a003-5ca0-4684-be5e-756f833a6d88 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.120200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407a003-5ca0-4684-be5e-756f833a6d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.170690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4407a003-5ca0-4684-be5e-756f833a6d88 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:45.187915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4407a003-5ca0-4684-be5e-756f833a6d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:45.188237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 821/1664] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:44 2022] PUT /identity/v3/projects/d1614aeb6d484886a1bdd6f3a55881da/users/3fedd4d0089e4b2288f662c9a13a79bd/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:45.197667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:45.197667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:45.391099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb404a7-e3f9-480a-b982-3da3682c47aa admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:45.403004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 844/1665] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:18:45.404811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.406674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.407615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.414193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:45.416865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.419745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.420198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] PATH_INFO: `/v3/users/c3659551bf7149dab52b041609469885` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.423009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3659551bf7149dab52b041609469885)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:45.425447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:45.491748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] MFA Rules not processed for user `3fedd4d0089e4b2288f662c9a13a79bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:45.495779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:45.629817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:45.695020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 845/1666] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:45.699303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:45.723812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967eb3cf-750a-4259-b47b-401cf99cc7a9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:45.730117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3659551bf7149dab52b041609469885'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:45.735033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:45.739324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.739324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.739704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.739890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:45.742377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:45.742377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:45.745934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b618cd7-d245-4cb0-a29f-48225516773e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:45.766497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3659551bf7149dab52b041609469885'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:45.775018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 846/1667] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:45.779283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:45.779579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:45.782146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:45.841062 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] MFA Rules not processed for user `b7c7538bc2bb4906932e73b56d71e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:45.844024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:45.867185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3659551bf7149dab52b041609469885'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:45.877559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3659551bf7149dab52b041609469885'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:45.881168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3659551bf7149dab52b041609469885'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:45.900526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 822/1668] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:45 2022] DELETE /identity/v3/users/c3659551bf7149dab52b041609469885 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:45.905331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:45.906370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:46.045870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 847/1669] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:46.045870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.045870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:46.065682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e009ccd-fb84-4ef3-9a98-4900d08ed798 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.074970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.075968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.076443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.078140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.079623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.080613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f265e-a9fe-457a-8bd0-2aaccf38fc21 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.085990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85ce201-bcc4-4cf1-9fa0-91190d750201 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.094143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.096807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.097619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.097619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.099871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.105902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.196038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 823/1670] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:45 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:46.197949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.199011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.200052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.233470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 848/1671] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:46 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:46.237077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.244155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:46.286514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:46.287734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:46.466814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 824/1672] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:46.468073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c8fe-9d44-4b0d-bb81-e3950d39719b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.468582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.483239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.483919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.484197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.484477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.491906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ee397-34e3-4fe7-bae8-29e8994b65d0 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.507969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.508690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.508973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.509248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.509998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.512275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.660823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.662526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.672552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 825/1673] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:46 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:46.672552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.696801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c7563-3e23-42d9-a6fa-962c4bf6a13b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.700697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 849/1674] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:46.709686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.709686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:46.712705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.714242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.714733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.715336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.716234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.727150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.816931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 826/1675] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:46 2022] POST /identity/v3/users => generated 282 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:46.821757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.838878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0834ee-f09d-494a-9246-92493b6142b8 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.841382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608a27f-96c0-467d-9084-5dc0eb09f3d5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.843413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.844090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.844376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.844656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.865691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.866751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.867223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.868271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.869202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.872281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.878620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.880125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.900936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 850/1676] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:46.902208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 827/1677] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:46.908355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.908855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.922519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c395f-2acf-4370-8a05-92101d25f31e service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.930943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca82a1b-6536-4f11-9ffa-ebd4f6b240b9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:46.931186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.932020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.932306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.932580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.934643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.937918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.942138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:46.943332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:46.943835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:46.944301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] PATH_INFO: `/v3/projects/72aab182890142bc9a75b09af277bd80/users/7c7c4dec0606477d9a325de88c2fb869/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:46.960533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 851/1678] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:46.965267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:46.984694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=72aab182890142bc9a75b09af277bd80, user_id=7c7c4dec0606477d9a325de88c2fb869, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:46.987869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:46.989896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ada-e808-4694-82ff-e26733767a0f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.006945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.008268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.008559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.008902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.009664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.011587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.030837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 852/1679] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:47.034525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.053848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b3a7f-d439-469e-8d6b-b8a83b1f729c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.061740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.067885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.067885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.067885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] PATH_INFO: `/v3/projects/24b5d9dc0d6642bba35111dcbb306592/users/2538a1299b1742b58374725996c6000e/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.085569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24b5d9dc0d6642bba35111dcbb306592, user_id=2538a1299b1742b58374725996c6000e, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.090447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbdd77-14db-42d0-9536-df15d19fc63e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.109028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 828/1680] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:46 2022] PUT /identity/v3/projects/72aab182890142bc9a75b09af277bd80/users/7c7c4dec0606477d9a325de88c2fb869/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:47.113114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.204785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 853/1681] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:47 2022] PUT /identity/v3/projects/24b5d9dc0d6642bba35111dcbb306592/users/2538a1299b1742b58374725996c6000e/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:47.207357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.208042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.208421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.242847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973f71f-b5f8-49d0-b3e2-7703e58444bb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.289255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] MFA Rules not processed for user `2538a1299b1742b58374725996c6000e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:47.293681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:47.315083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:47.374436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=3,keystone:INSERT=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:47.391831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.392528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.392811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.393087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.393938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.395545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.414208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 829/1682] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:18:47.419063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.441260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76079633-72ed-42fc-87c3-7edfd9c1277e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.450493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.451402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.451683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.451959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] PATH_INFO: `/v3/projects/72aab182890142bc9a75b09af277bd80/users/7c7c4dec0606477d9a325de88c2fb869/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.459531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72aab182890142bc9a75b09af277bd80, user_id=7c7c4dec0606477d9a325de88c2fb869, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.460126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 854/1683] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:47.462527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3eb6ba-5288-4f71-a9b6-662655442d52 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.465421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.488055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2ede2-0547-4e28-9ef0-f317fc25fe96 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.489382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 830/1684] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:47 2022] PUT /identity/v3/projects/72aab182890142bc9a75b09af277bd80/users/7c7c4dec0606477d9a325de88c2fb869/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:47.501956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.502192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.502499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.628716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.629512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.629838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.630121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.630894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.633818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.701394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 855/1685] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:47 2022] POST /identity/v3/projects => generated 365 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:47.705620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.809904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] MFA Rules not processed for user `7c7c4dec0606477d9a325de88c2fb869`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:47.811207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:47.850366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c763b98-6564-4268-8b9e-e418f02d3036 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:47.867710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:47.868664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:47.869002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:47.869375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:47.870203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:47.872279 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:47.950902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 831/1686] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:47.963449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:47.965034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:48.079326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 856/1687] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:47 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:48.079326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:48.082196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fcb588-385c-48aa-91a7-65cfeb86a5e5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.086965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee52f6-fe4d-4331-ae6a-bcec8a4d1425 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.089149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.090175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.090611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.091040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.093262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:48.110028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.111664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.112075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.112422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.113417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.119044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.136576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:48.164183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 857/1688] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:18:48.166438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:48.184986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006dc54e-d4fd-4414-9225-e735be0c9517 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.189086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.190875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.205057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 832/1689] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:18:48.208807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.209853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.210229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.210869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] PATH_INFO: `/v3/projects/ea5804202c634a36b00da4b230035be9/users/3670cc0e5db3411ca5ab3dbc16a77aec/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.250776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5804202c634a36b00da4b230035be9, user_id=3670cc0e5db3411ca5ab3dbc16a77aec, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.261790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.345779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 858/1690] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:48 2022] PUT /identity/v3/projects/ea5804202c634a36b00da4b230035be9/users/3670cc0e5db3411ca5ab3dbc16a77aec/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:48.347567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:48.364317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce4273-1123-4892-bc8a-db5421c0f286 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.570115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.571536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.571908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.572295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.573253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.575146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c689b61-78dd-4878-8833-b349ee0d2e9c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.602517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 833/1691] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:48.607006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:48.627912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea159f82-c6c8-4eae-91bf-6377a242e171 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.640245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.641402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.641876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.642480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] PATH_INFO: `/v3/projects/ea5804202c634a36b00da4b230035be9/users/3670cc0e5db3411ca5ab3dbc16a77aec/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.646757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea5804202c634a36b00da4b230035be9, user_id=3670cc0e5db3411ca5ab3dbc16a77aec, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.654586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.685805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 859/1692] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:48 2022] PUT /identity/v3/projects/ea5804202c634a36b00da4b230035be9/users/3670cc0e5db3411ca5ab3dbc16a77aec/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:48.699569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.700425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.700855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.775237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] MFA Rules not processed for user `3670cc0e5db3411ca5ab3dbc16a77aec`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:48.778667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:48.811085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:48.812899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:48.957359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6370fc-f7fc-4833-95f6-f304ce5db19f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:48.977491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:48.981071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:48.982327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:48.982814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:48.984956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] PATH_INFO: `/v3/projects/e9fd02f6311546dd9be6735c36c1d404` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:48.984956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9fd02f6311546dd9be6735c36c1d404)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:48.986947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:48.989856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 834/1693] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:49.003483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:49.004178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:49.207419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d312-c760-4f3e-8b93-5a61c739c965 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:49.242234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9fd02f6311546dd9be6735c36c1d404', 'request_id': 'req-daf305db-d035-4f65-b5f3-847dd3b92d74'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:49.262835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9fd02f6311546dd9be6735c36c1d404', 'request_id': 'req-daf305db-d035-4f65-b5f3-847dd3b92d74'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:49.294968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9fd02f6311546dd9be6735c36c1d404', 'request_id': 'req-daf305db-d035-4f65-b5f3-847dd3b92d74'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:49.380059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:49.380686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:49.380970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:49.381241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:49.445495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:49.457346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] The token cache is being invalidate because project e9fd02f6311546dd9be6735c36c1d404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:18:49.459699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:49.462376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-daf305db-d035-4f65-b5f3-847dd3b92d74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:49.467684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 860/1694] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:18:48 2022] DELETE /identity/v3/projects/e9fd02f6311546dd9be6735c36c1d404 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:49.475775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:49.476521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:49.480409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:49.519987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:49.522233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f783f-fbb0-48c4-b3ac-787aebeff511 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:49.539982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 835/1695] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:18:49.579327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:49.584650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:49.805252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:49.805612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:49.805978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:49.807716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 861/1696] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:49.818145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:49.823690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:49.849077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:49.851152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:49.863148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 836/1697] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:49.865621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a851fba-fd55-4d32-8cc7-f8b4b89ec2fa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:49.868195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:49.885607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc700d-8cbf-4c00-a544-9a082ee46bcb None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:49.897602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:49.898750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:49.898750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:49.899500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:49.899603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:49.900450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:49.900744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:49.901942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:49.902571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:18:49.903088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:49.919585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:49.919787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:49.956173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 837/1698] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:18:49.959512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:50.000247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670df0c-d9b3-4fc1-8d2c-bfdd62b63382 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:50.020061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:50.020864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.021015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.021284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.022013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.024931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.104981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.106986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.138130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 862/1699] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:50.189469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 838/1700] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:18:49 2022] POST /identity/v3/projects => generated 367 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:50.194262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:50.216639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec47f58-fde5-4c99-9af2-0deca430dcd2 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:50.307882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:50.404872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:50.409330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.409330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.409330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.409330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.409330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.590954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:50.591635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 863/1701] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:18:50 2022] POST /identity/v3/users => generated 284 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:18:50.606398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfeb789-1746-4534-915e-7743703692a6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:50.618517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:50.619404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.620751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.621529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.623703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.625644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.643302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:50.643848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 839/1702] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:18:50.656685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3764d2b-58fd-43b7-9e7d-77777e17af68 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:50.662695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:50.665173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.665524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.665949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.666838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.668773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d79dd-119a-4c06-a614-a5942102f5a9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.692010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:50.700433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 864/1703] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:18:50.708611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2de20-9b17-43bd-b380-33b150c10072 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:50.721806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:50.723351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.723712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.724060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] PATH_INFO: `/v3/projects/c0d9e152dc9144a0a95e293415109307/users/4ee36aa290f54d1a9d187ccb5aceb11b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.757497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0d9e152dc9144a0a95e293415109307, user_id=4ee36aa290f54d1a9d187ccb5aceb11b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:50.762290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d693001-268a-4d8d-8a91-5ce39d4ee9fb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:50.874393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 840/1704] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:18:50 2022] PUT /identity/v3/projects/c0d9e152dc9144a0a95e293415109307/users/4ee36aa290f54d1a9d187ccb5aceb11b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:18:50.885541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.885858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.886140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:50.956723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:50.962633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] MFA Rules not processed for user `4ee36aa290f54d1a9d187ccb5aceb11b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:50.965520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:50.997064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:50.997352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:50.997633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:51.013799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:51.123019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] MFA Rules not processed for user `8dd9bbd11fd74ed1963cc0ecc84d643b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:51.126315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:51.259248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 865/1705] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:51.266668 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:51.333938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 841/1706] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:51.355175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:51.386236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:51.403746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06b4500-8adc-4eea-970e-cd9ae79a07ce None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:51.408049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:51.408789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:51.409128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:51.409471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:51.429072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:51.431571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:51.506219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 866/1707] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:51.625486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:51.627008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:51.647718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ea9cb-fb64-4055-9396-a98e8a5a922b service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:51.663114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:51.663881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:51.664844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:51.665316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:51.675089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:51.691085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19371e-fb40-429d-898c-2ffa026e98f4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:51.712503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:51.713618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:51.717483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:51.717895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:51.768118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:51.778581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0c341-11a1-46d9-8677-c56f6cbaa3ea service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:51.831793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 842/1708] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:51.883931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:51.885609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f187334-3382-4e5d-a7e3-6550126f2a3e service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:51.926953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 867/1709] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:18:52.658162 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:52.658664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:52.658753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:52.724621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] MFA Rules not processed for user `a7c271c1c0014af0bfc280e36135ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:52.731957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:52.799374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:52.926586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 843/1710] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:52.928531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707743-7511-49fe-b1f7-4a0a81d82e47 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:52.928994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707743-7511-49fe-b1f7-4a0a81d82e47 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:52.929154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29707743-7511-49fe-b1f7-4a0a81d82e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:52.970830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-29707743-7511-49fe-b1f7-4a0a81d82e47 None None] MFA Rules not processed for user `a7c271c1c0014af0bfc280e36135ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:52.972467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-29707743-7511-49fe-b1f7-4a0a81d82e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:52.986430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 868/1711] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:53.000348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:53.003025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:53.036442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c7335-bec8-4ebe-97d6-d0e9743a75df None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:53.044740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:53.045580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:53.047052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:53.047052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:53.069937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:53.075630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3d7fb-274a-40c3-a486-ec390127b245 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:53.088735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 844/1712] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:53.287913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:53.904893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:53.904893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:53.904893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:53.906686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 869/1713] 10.222.0.65 () {54 vars in 912 bytes} [Fri Jun 24 15:18:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:53.924133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8267-a5af-49f2-9d8e-e4f2b3125371 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:53.924133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8267-a5af-49f2-9d8e-e4f2b3125371 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:53.924133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a8267-a5af-49f2-9d8e-e4f2b3125371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:54.034668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-565a8267-a5af-49f2-9d8e-e4f2b3125371 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:54.038161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-565a8267-a5af-49f2-9d8e-e4f2b3125371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:54.187753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 845/1714] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:18:54.200659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:54.202767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:54.262344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6efb6a-c8e3-4f47-927a-ec4c0420418e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:54.272118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:54.272981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:54.274771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:54.276069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:54.310754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:54.320256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b8864-a2d9-4cd1-a8b6-f20164214b00 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:54.354856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 870/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:54.722471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:54.722763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:54.723048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:54.790653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] MFA Rules not processed for user `d86ae885b5184169b0f7742acd58f08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:54.792062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:54.977595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 846/1716] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:54.989826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d90c9-450f-44a7-bb1a-28c48ce2dc75 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:54.990264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d90c9-450f-44a7-bb1a-28c48ce2dc75 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:54.990641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d90c9-450f-44a7-bb1a-28c48ce2dc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.040956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-433d90c9-450f-44a7-bb1a-28c48ce2dc75 None None] MFA Rules not processed for user `d86ae885b5184169b0f7742acd58f08e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:55.049614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-433d90c9-450f-44a7-bb1a-28c48ce2dc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:55.097924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 871/1717] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:55.104918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:55.131503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba2e1-c116-4b79-88f4-d1a6dca89d66 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:55.145506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:55.147019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:55.147332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:55.147616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.171600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:55.177186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d097dc-7d61-42fe-bbd8-ed7504a0c501 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:55.214377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 847/1718] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:55.524301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f05536-6097-422a-bd79-37ea8343244f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:55.524820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f05536-6097-422a-bd79-37ea8343244f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:55.524980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f05536-6097-422a-bd79-37ea8343244f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.526711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 872/1719] 10.222.0.65 () {54 vars in 960 bytes} [Fri Jun 24 15:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:55.532965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3f07-ee7d-404c-98e2-0ccccafd2e68 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:55.533483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3f07-ee7d-404c-98e2-0ccccafd2e68 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:55.534216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b3f07-ee7d-404c-98e2-0ccccafd2e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.594355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-339b3f07-ee7d-404c-98e2-0ccccafd2e68 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:55.600316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-339b3f07-ee7d-404c-98e2-0ccccafd2e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:55.620335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:55.620627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:55.620899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.671711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:55.681446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] MFA Rules not processed for user `a7c271c1c0014af0bfc280e36135ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:55.700120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:55.725013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 873/1720] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:55.839161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 848/1721] 10.222.0.65 () {58 vars in 1057 bytes} [Fri Jun 24 15:18:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:55.865205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:55.883978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18418cd8-f62c-419d-a676-e181c7c63c2c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:55.902560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:55.911953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:55.911953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:55.911953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:55.913325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:55.969650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:55.971764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbab451-d0c8-4214-8fac-8cc7cd279a9a service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:56.014337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 874/1722] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:56.553823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785c84-a66a-477b-9658-78b954ab5ae1 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:56.554767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785c84-a66a-477b-9658-78b954ab5ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:56.555201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc785c84-a66a-477b-9658-78b954ab5ae1 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:56.556946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 849/1723] 10.222.0.65 () {54 vars in 912 bytes} [Fri Jun 24 15:18:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:18:56.574345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809772e-fdbd-4f33-9cd8-64140dd28d5e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:56.579368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809772e-fdbd-4f33-9cd8-64140dd28d5e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:56.579912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809772e-fdbd-4f33-9cd8-64140dd28d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:56.607212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f809772e-fdbd-4f33-9cd8-64140dd28d5e None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:56.611812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f809772e-fdbd-4f33-9cd8-64140dd28d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:56.643625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 875/1724] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:18:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:56.734984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785c84-a66a-477b-9658-78b954ab5ae1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:56.793514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc785c84-a66a-477b-9658-78b954ab5ae1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:56.823571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:56.824840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:56.825994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:56.827798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:56.857997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:56.862957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f798a55-6f3a-4726-bcdb-680c6417e0da service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:56.891778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 850/1725] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:57.089605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:57.089941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:57.090221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:57.162346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] MFA Rules not processed for user `c42165e400c247aba309d3c7a370f476`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:57.164696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:57.314317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 876/1726] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:18:57.372884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:57.373172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:57.373452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:57.416728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] MFA Rules not processed for user `b7c7538bc2bb4906932e73b56d71e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:57.418800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:57.535034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 851/1727] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:57.904096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:57.921702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20859754-6de8-4fd6-a2d2-7ea082c37355 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:57.946052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:57.948071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:57.948466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:57.948943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:57.970705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:57.977847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197433b-0c47-4077-8e54-80710f54b26e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:58.006411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 877/1728] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:18:58.314091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:58.319625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:58.494141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df7189-3b3b-4512-900f-4603d4cc0d0e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:58.513552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:58.514648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:58.514936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:58.515217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] PATH_INFO: `/v3/users/3fedd4d0089e4b2288f662c9a13a79bd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:58.517193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fedd4d0089e4b2288f662c9a13a79bd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:58.520177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:58.906220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fedd4d0089e4b2288f662c9a13a79bd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:58.925432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:58.942504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fedd4d0089e4b2288f662c9a13a79bd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:59.116050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fedd4d0089e4b2288f662c9a13a79bd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:59.140692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fedd4d0089e4b2288f662c9a13a79bd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:59.142354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fedd4d0089e4b2288f662c9a13a79bd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:18:59.152663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 852/1729] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:18:58 2022] DELETE /identity/v3/users/3fedd4d0089e4b2288f662c9a13a79bd => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:18:59.160380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a8ac-5cab-4a87-8255-5ecbb1f5cdd1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:59.161220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a8ac-5cab-4a87-8255-5ecbb1f5cdd1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:59.161700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a8ac-5cab-4a87-8255-5ecbb1f5cdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:59.222040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6424a8ac-5cab-4a87-8255-5ecbb1f5cdd1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:18:59.231901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6424a8ac-5cab-4a87-8255-5ecbb1f5cdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:59.346582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:18:59.389842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 878/1730] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:18:59.448422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:18:59.450056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:18:59.567322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bd61c-1764-476d-bf1f-01a10bbe6164 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:18:59.572300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:18:59.574256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:18:59.574256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:18:59.574256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:18:59.589956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:18:59.591611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:18:59.606388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 853/1731] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:00.497199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:00.498171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:00.498596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:00.550965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] MFA Rules not processed for user `8dd9bbd11fd74ed1963cc0ecc84d643b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:00.552963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:00.762886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 879/1732] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:00.988291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:00.990454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:01.014015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae2e137-19b0-4cfb-9ad5-ab1b5857bbcd service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:01.036593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:01.037823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:01.039465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:01.039899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] PATH_INFO: `/v3/projects/d1614aeb6d484886a1bdd6f3a55881da` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:01.046591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1614aeb6d484886a1bdd6f3a55881da)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:01.046591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: WARNING py.warnings [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 24 15:19:01.046591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: warnings.warn(msg) Jun 24 15:19:01.046591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: Jun 24 15:19:01.048450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:01.345908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1614aeb6d484886a1bdd6f3a55881da', 'request_id': 'req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:01.387617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1614aeb6d484886a1bdd6f3a55881da', 'request_id': 'req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:01.570681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1614aeb6d484886a1bdd6f3a55881da', 'request_id': 'req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:01.591117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] The token cache is being invalidate because project d1614aeb6d484886a1bdd6f3a55881da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:01.591415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:01.592125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d37bf8a2-a99d-400c-a8b5-a338161ef5eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:01.595196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 854/1733] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:00 2022] DELETE /identity/v3/projects/d1614aeb6d484886a1bdd6f3a55881da => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:01.599738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:01.618748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56edea-bc6f-4337-bd40-610890f34680 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:01.622365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036207a-a371-4497-bd09-70b575199dfd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:01.622832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036207a-a371-4497-bd09-70b575199dfd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:01.623274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036207a-a371-4497-bd09-70b575199dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:01.666416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f036207a-a371-4497-bd09-70b575199dfd None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:01.669432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f036207a-a371-4497-bd09-70b575199dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:01.726637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:01.727818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:01.728244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:01.729185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] PATH_INFO: `/v3/users/7c7c4dec0606477d9a325de88c2fb869` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:01.730643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7c4dec0606477d9a325de88c2fb869)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:01.733142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:01.835617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 855/1734] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:19:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:02.012319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7c4dec0606477d9a325de88c2fb869'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:02.044984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7c4dec0606477d9a325de88c2fb869'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:02.166675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7c4dec0606477d9a325de88c2fb869'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:02.167968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7c4dec0606477d9a325de88c2fb869'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:02.195412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-99505f09-aecf-4044-93b5-62722e70cf7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7c4dec0606477d9a325de88c2fb869'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:02.224781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 880/1735] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:01 2022] DELETE /identity/v3/users/7c7c4dec0606477d9a325de88c2fb869 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:02.473044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036207a-a371-4497-bd09-70b575199dfd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:02.476623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f036207a-a371-4497-bd09-70b575199dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:02.491519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:02.645240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036207a-a371-4497-bd09-70b575199dfd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:02.750026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:02.750945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:02.751235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:02.751970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:02.763789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:02.904013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:02.906370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:02.936303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 856/1736] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:19:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:19:03.577643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:03.579261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:03.579891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:03.621556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:03.624298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:03.649332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:03.843149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 881/1737] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jun 24 15:19:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:04.242312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:04.252307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:04.313690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8de7ef-c446-4968-b810-a9c921594d98 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:04.352912 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:04.361406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:04.361751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:04.361751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:04.361751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:04.361751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:04.392249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:04.395962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:04.453171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 857/1738] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:04.615182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:04.627292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:04.657025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c72153-33e1-408a-8297-14f69cf6b08d service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:04.684309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595d375-0efd-40df-98b4-672abcd53ac8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:04.696237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:04.700636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:04.701292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:04.701631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:04.702710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] PATH_INFO: `/v3/users/2538a1299b1742b58374725996c6000e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:04.703671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:04.705225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:04.706250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] PATH_INFO: `/v3/projects/72aab182890142bc9a75b09af277bd80` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:04.714110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2538a1299b1742b58374725996c6000e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:04.715749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72aab182890142bc9a75b09af277bd80)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:04.720966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:04.724325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:05.119284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2538a1299b1742b58374725996c6000e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.122557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72aab182890142bc9a75b09af277bd80', 'request_id': 'req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.182976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72aab182890142bc9a75b09af277bd80', 'request_id': 'req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.197681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2538a1299b1742b58374725996c6000e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.354065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72aab182890142bc9a75b09af277bd80', 'request_id': 'req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.387036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] The token cache is being invalidate because project 72aab182890142bc9a75b09af277bd80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:05.391813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.392520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2c01117e-b4dc-4592-8b4d-7c3ca57dd6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.396080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 858/1739] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:04 2022] DELETE /identity/v3/projects/72aab182890142bc9a75b09af277bd80 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:05.401647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa3d5b-7aa2-4871-8094-be44539752f5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:05.402331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa3d5b-7aa2-4871-8094-be44539752f5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:05.403669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfa3d5b-7aa2-4871-8094-be44539752f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:05.452419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2538a1299b1742b58374725996c6000e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.454261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2538a1299b1742b58374725996c6000e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.485243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ef900f35-0713-4f5b-880e-5b4ac865ceb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2538a1299b1742b58374725996c6000e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:05.489691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fcfa3d5b-7aa2-4871-8094-be44539752f5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:05.491345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fcfa3d5b-7aa2-4871-8094-be44539752f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:05.515294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 882/1740] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:04 2022] DELETE /identity/v3/users/2538a1299b1742b58374725996c6000e => generated 0 bytes in 1161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:05.519196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:05.520837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:05.523595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:05.612013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:05.616630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:05.648800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 859/1741] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:05.658886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:05.661878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:05.662365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:05.735445 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:05.741691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:05.832914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:05.926488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 883/1742] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:05.963390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 860/1743] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:05.976678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:05.984734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a556a09-76f8-4027-94ff-aed6959e1673 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:05.995520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:05.998102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:06.042976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.050589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.053021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.059073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.061489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:06.063993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.067251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.125612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 884/1744] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:06.136313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:06.175152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470252-4948-4dd4-ba31-1278777a6b12 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.207980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.208798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.209088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.209370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.210666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.216698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.231329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37cd0d-4484-4427-bf19-51149fb5d5d1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.249905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.275440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.275440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.275440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.316118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.318616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.364439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 861/1745] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:06.440049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 885/1746] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:06 2022] POST /identity/v3/projects => generated 385 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:06.441408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:06.467546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31197b-19ab-4a49-8201-cb9180ccd570 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.615823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.617277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.617658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.617969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.618674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.620675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.650555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:06.823806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 862/1747] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:06 2022] POST /identity/v3/users => generated 293 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:06.855671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:06.861472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df3c5ac-0b33-422f-8a55-45e4f3b488b6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.869064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.870147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.870535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.870929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.871779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.873530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.903682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 886/1748] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:06.907900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:06.920543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5a08-2700-4dc9-8e4e-b1e93bfc1300 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.926030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.926805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.927080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.927408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:06.928612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:06.930874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788a70eb-faa2-49d7-9562-6877ba4cb636 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:06.942202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 863/1749] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:06.946209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:06.958037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433239de-d2b6-4a66-ac6e-0591a5ce8a8e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:06.964106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:06.965022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:06.965307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:06.965583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] PATH_INFO: `/v3/projects/2ab151e0b96744188bc0677b04523551/users/115769e564c44e248188d2de507597b0/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:07.004198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab151e0b96744188bc0677b04523551, user_id=115769e564c44e248188d2de507597b0, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:07.007404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:07.154764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 887/1750] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:06 2022] PUT /identity/v3/projects/2ab151e0b96744188bc0677b04523551/users/115769e564c44e248188d2de507597b0/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:07.162647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e532-d9ff-48b7-b7b9-ec017d1e5e59 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:07.166902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e532-d9ff-48b7-b7b9-ec017d1e5e59 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:07.166902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49e532-d9ff-48b7-b7b9-ec017d1e5e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:07.215027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6f49e532-d9ff-48b7-b7b9-ec017d1e5e59 None None] MFA Rules not processed for user `115769e564c44e248188d2de507597b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:07.217143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6f49e532-d9ff-48b7-b7b9-ec017d1e5e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:07.410346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 864/1751] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:07.411388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:07.621893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2afa82-172c-43ba-9d90-f59e637095f1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:07.653761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:07.660597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:07.661158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:07.661826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:07.662897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:07.666080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:07.685263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:07.744219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:07.744547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:07.744876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:07.802533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] MFA Rules not processed for user `c42165e400c247aba309d3c7a370f476`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:07.804451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:07.870659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 888/1752] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:07 2022] POST /identity/v3/projects => generated 383 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:07.874982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:08.028498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 865/1753] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:08.090621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501b86d-b50d-49be-aa88-16fc5293a926 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:08.102879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:08.102879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:08.102879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:08.102879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:08.103320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:08.103320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:08.298364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 889/1754] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:07 2022] POST /identity/v3/users => generated 298 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:08.301432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:08.333110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f6455-9e6e-4b4c-8777-986f5deb6442 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:08.362577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:08.362577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:08.362577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:08.362577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:08.364039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:08.394672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:08.450231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 866/1755] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:08.452116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:08.473050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad9b5e-f982-4f1b-935a-a281a76105fe admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:08.497008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:08.499761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:08.500250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:08.501661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] PATH_INFO: `/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456/users/bad6189fd0154518a4a7cc60ef5b4f85/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:08.551440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbad3ec1e2f44068f18bd16cd0a3456, user_id=bad6189fd0154518a4a7cc60ef5b4f85, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:08.561831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:08.774141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:08.778605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 890/1756] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:08 2022] PUT /identity/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456/users/bad6189fd0154518a4a7cc60ef5b4f85/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:08.790406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833723f8-f189-462d-93af-ffe5aed09858 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:08.886243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:08.887119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:08.887424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:08.887676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:08.888420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:08.895947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a3b1d1-5aea-4ac8-acd7-f6f8fd500516 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:08.920858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:08.922069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 867/1757] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:08.947350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae2fb02-db03-49aa-bc55-549f41271de2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:08.953412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:08.954366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:08.954924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:08.955538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] PATH_INFO: `/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456/users/bad6189fd0154518a4a7cc60ef5b4f85/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:08.986685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbad3ec1e2f44068f18bd16cd0a3456, user_id=bad6189fd0154518a4a7cc60ef5b4f85, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:08.989458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:09.041032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 891/1758] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:08 2022] PUT /identity/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456/users/bad6189fd0154518a4a7cc60ef5b4f85/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:09.051752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:09.057440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:09.057440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:09.182513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] MFA Rules not processed for user `bad6189fd0154518a4a7cc60ef5b4f85`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:09.184183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:09.356994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:09.472587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 868/1759] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:09.484408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:09.486728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:09.734002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972c5bd-6c38-4074-b91a-9eac10298733 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:09.743915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:09.744593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:09.744871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:09.745143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:09.811171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:09.822386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:09.883204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 892/1760] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:10.031321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:10.112684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:10.223072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea095fa3-f50f-437d-a0a3-31a40383cef6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:10.236651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:10.237795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:10.238439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:10.238862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] PATH_INFO: `/v3/users/115769e564c44e248188d2de507597b0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:10.244931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=115769e564c44e248188d2de507597b0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:10.247182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:10.804747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '115769e564c44e248188d2de507597b0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:10.824150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '115769e564c44e248188d2de507597b0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:10.868735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:10.870657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:10.914302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2b778-03e2-4f1a-a4ff-6b8aa65b4771 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:10.924567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:10.930267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:10.930649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:10.930998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] PATH_INFO: `/v3/projects/24b5d9dc0d6642bba35111dcbb306592` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:10.936741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=24b5d9dc0d6642bba35111dcbb306592)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:10.938933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:10.942786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '115769e564c44e248188d2de507597b0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:10.952447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '115769e564c44e248188d2de507597b0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:10.954077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '115769e564c44e248188d2de507597b0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:10.967194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 869/1761] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:10 2022] DELETE /identity/v3/users/115769e564c44e248188d2de507597b0 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:10.968921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:10.976423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:11.128004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24b5d9dc0d6642bba35111dcbb306592', 'request_id': 'req-ad3841da-10a1-4415-a0bb-847dd10e5e3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.161662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24b5d9dc0d6642bba35111dcbb306592', 'request_id': 'req-ad3841da-10a1-4415-a0bb-847dd10e5e3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.183395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24b5d9dc0d6642bba35111dcbb306592', 'request_id': 'req-ad3841da-10a1-4415-a0bb-847dd10e5e3c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.204636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3433-c8fc-46c7-a4a5-31a09a4d07a5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:11.420326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:11.420326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:11.420326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:11.420326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] PATH_INFO: `/v3/users/4ee36aa290f54d1a9d187ccb5aceb11b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:11.421807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee36aa290f54d1a9d187ccb5aceb11b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:11.421807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:11.568502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] The token cache is being invalidate because project 24b5d9dc0d6642bba35111dcbb306592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:11.572806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.572806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ad3841da-10a1-4415-a0bb-847dd10e5e3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.574619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 893/1762] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:10 2022] DELETE /identity/v3/projects/24b5d9dc0d6642bba35111dcbb306592 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:11.576128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6f7-0c75-4c0b-a326-a7fe8c274ad3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:11.576525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6f7-0c75-4c0b-a326-a7fe8c274ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:11.576905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae6f7-0c75-4c0b-a326-a7fe8c274ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:11.623024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-33aae6f7-0c75-4c0b-a326-a7fe8c274ad3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:11.628525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-33aae6f7-0c75-4c0b-a326-a7fe8c274ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:11.653045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 894/1763] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:11.654663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:11.655051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:11.655443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:11.657160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 895/1764] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:19:11.658044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:11.663020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:11.700998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b5862-6992-4d11-b60c-1505d9818168 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:11.714500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:11.719621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:11.719621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:11.719621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] PATH_INFO: `/v3/users/3670cc0e5db3411ca5ab3dbc16a77aec` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:11.719621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3670cc0e5db3411ca5ab3dbc16a77aec)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:11.722690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:11.815487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=83,keystone:INSERT=6,keystone:DELETE=11 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:11.821883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee36aa290f54d1a9d187ccb5aceb11b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.868141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee36aa290f54d1a9d187ccb5aceb11b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.969406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3670cc0e5db3411ca5ab3dbc16a77aec'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.992035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee36aa290f54d1a9d187ccb5aceb11b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:11.995757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3670cc0e5db3411ca5ab3dbc16a77aec'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.000371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee36aa290f54d1a9d187ccb5aceb11b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.001203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee36aa290f54d1a9d187ccb5aceb11b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.020473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 870/1765] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:10 2022] DELETE /identity/v3/users/4ee36aa290f54d1a9d187ccb5aceb11b => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:12.020473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:12.023469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:12.050419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3670cc0e5db3411ca5ab3dbc16a77aec'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.051113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3670cc0e5db3411ca5ab3dbc16a77aec'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.060697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df4c0885-0237-496b-a4d0-816c0db139b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3670cc0e5db3411ca5ab3dbc16a77aec'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:12.076696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 896/1766] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:11 2022] DELETE /identity/v3/users/3670cc0e5db3411ca5ab3dbc16a77aec => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:12.078118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970f69-12ab-4456-b871-8f633bdabf3e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:12.078406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970f69-12ab-4456-b871-8f633bdabf3e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:12.078687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee970f69-12ab-4456-b871-8f633bdabf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:12.121150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ee970f69-12ab-4456-b871-8f633bdabf3e None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:12.124782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ee970f69-12ab-4456-b871-8f633bdabf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:12.235589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b3896-ae19-4eee-8358-42cadf89a268 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:12.254695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:12.313433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 897/1767] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:12.314715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:12.315005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:12.315290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:12.344306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:12.345560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:12.393568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:12.394319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:12.394604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:12.394879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:12.409393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:12.502110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 898/1768] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:12.586742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:12.600028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:12.650705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 871/1769] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:12.761547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:12.761547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:12.800280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acae3e9a-b6c0-4ebf-b848-389d91b4b7a9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:12.811578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:12.816580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:12.817103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:12.817389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:12.836923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:12.840987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf5ea8-5cff-433a-905b-bc202988d62a service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:12.884339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 899/1770] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:14.431803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:14.433405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:14.467118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93e336-6684-4ed4-abab-871d6ec79a6e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:14.479141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:14.483628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:14.483628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:14.483628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:14.512680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:14.514604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91ac53-96fd-4ec2-9c2c-eb246c7056db service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:14.542225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 872/1771] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:14.818102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:14.818102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:14.818102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:14.830217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 900/1772] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:19:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:19:14.967902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ab26-7e3a-4059-a6a3-1d225564ee2a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:14.967902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ab26-7e3a-4059-a6a3-1d225564ee2a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:14.967902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633ab26-7e3a-4059-a6a3-1d225564ee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:14.971969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5633ab26-7e3a-4059-a6a3-1d225564ee2a None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:14.973300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5633ab26-7e3a-4059-a6a3-1d225564ee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:15.024108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 873/1773] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:19:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:15.340876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:15.567110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:15.575095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:15.617338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4f55a-c571-46b8-ba58-e975a3b6d9fb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:15.757538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:15.757538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:15.757538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:15.757538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] PATH_INFO: `/v3/projects/ea5804202c634a36b00da4b230035be9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:15.758449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea5804202c634a36b00da4b230035be9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:15.758449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:15.949537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:15.974805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea5804202c634a36b00da4b230035be9', 'request_id': 'req-820cf94f-ee05-457b-b6d1-31bc509b21fd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:15.980741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea5804202c634a36b00da4b230035be9', 'request_id': 'req-820cf94f-ee05-457b-b6d1-31bc509b21fd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.004035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea5804202c634a36b00da4b230035be9', 'request_id': 'req-820cf94f-ee05-457b-b6d1-31bc509b21fd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.211122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] The token cache is being invalidate because project ea5804202c634a36b00da4b230035be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:16.211122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.212226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.221875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:16.229124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:16.230261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:16.245117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 901/1774] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:15 2022] DELETE /identity/v3/projects/ea5804202c634a36b00da4b230035be9 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:16.278250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:16.280181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.295498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:16.309960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.433522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 874/1775] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:16.435158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:16.436996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.475525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df525c82-c871-4498-a6b8-965a381d9c0b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:16.488387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cf94f-ee05-457b-b6d1-31bc509b21fd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:16.493969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:16.496046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:16.498551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:16.499521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] PATH_INFO: `/v3/projects/c0d9e152dc9144a0a95e293415109307` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:16.503177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0d9e152dc9144a0a95e293415109307)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:16.507825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:16.509016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:16.511799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:16.512288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:16.512728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:16.516402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.549902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:16.553605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96416dcc-4a5a-44aa-b3a3-7267e3f29a97 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:16.582446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 902/1776] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:16.584457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:16.585853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:16.588634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:16.613448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:16.614832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.625442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 903/1777] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:16.627502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:16.628818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:16.660557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc4bd3b-8369-45e0-bdf2-638112e8d898 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:16.722765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:16.723675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:16.723956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:16.724234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] PATH_INFO: `/v3/projects/2ab151e0b96744188bc0677b04523551` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:16.728794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab151e0b96744188bc0677b04523551)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:16.735525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:16.740237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0d9e152dc9144a0a95e293415109307', 'request_id': 'req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.793647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0d9e152dc9144a0a95e293415109307', 'request_id': 'req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.937885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0d9e152dc9144a0a95e293415109307', 'request_id': 'req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.971312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] The token cache is being invalidate because project c0d9e152dc9144a0a95e293415109307 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:16.973516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.974197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:16.981996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 875/1778] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:16 2022] DELETE /identity/v3/projects/c0d9e152dc9144a0a95e293415109307 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:16.985044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:16.996597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:17.024467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab151e0b96744188bc0677b04523551', 'request_id': 'req-bc27cb5b-7606-46be-a308-b0923f3725c7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.024467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab151e0b96744188bc0677b04523551', 'request_id': 'req-bc27cb5b-7606-46be-a308-b0923f3725c7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.025125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab151e0b96744188bc0677b04523551', 'request_id': 'req-bc27cb5b-7606-46be-a308-b0923f3725c7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.130671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffa4b6d-0440-4cf0-a0c5-4793c8dd2f7f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:17.203349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] The token cache is being invalidate because project 2ab151e0b96744188bc0677b04523551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:17.213214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.214378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-bc27cb5b-7606-46be-a308-b0923f3725c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.215373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:17.216147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.216509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.216793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.238329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 904/1779] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:16 2022] DELETE /identity/v3/projects/2ab151e0b96744188bc0677b04523551 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:17.240595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.240595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.240595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.253976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:17.259176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:17.262625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:17.292844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:17.302339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:17.308740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 876/1780] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:17.310472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:17.318937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:17.325475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 905/1781] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:17.329054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:17.335429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:17.350991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b262-b68a-44af-8ac3-d4afec5cd125 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:17.363073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01784b4-a5d9-43bc-b13a-cf451e3d8f37 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:17.365372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:17.366331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.366611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.366879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] PATH_INFO: `/v3/users/bad6189fd0154518a4a7cc60ef5b4f85` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.370807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad6189fd0154518a4a7cc60ef5b4f85)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:17.373509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:17.377937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:17.378829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.380092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.380542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.381420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:17.383564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e098c-644f-4213-8dca-70af8d6244a2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:17.542585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 906/1782] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:17 2022] POST /identity/v3/projects => generated 369 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:17.544546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.544836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.545119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.757224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:17.757224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:17.757224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 907/1783] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:17.757224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:17.757224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc6e08-54a6-45b5-99c8-43fe9b78bf7d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:17.758435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:17.758435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.758435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.758435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.759002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:17.759002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:17.925700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 908/1784] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:17 2022] POST /identity/v3/users => generated 285 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:17.926868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:17.947013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40661704-6d16-44cc-b87a-bf85c085aa9d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:17.951610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad6189fd0154518a4a7cc60ef5b4f85'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.969845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:17.970808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:17.971239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:17.971619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:17.972565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:17.972959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:17.974159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad6189fd0154518a4a7cc60ef5b4f85'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:17.976170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:17.997660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 909/1785] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:18.007301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.010947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2a2f0-024b-4204-bfa8-0621ae105ad1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.017575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.018579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.018765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.019132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.019986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.021653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.036377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 910/1786] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:18.036377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.050985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d042a95-f97d-467b-a844-2e9f49126cb4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.058020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.060201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad6189fd0154518a4a7cc60ef5b4f85'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:18.061868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.063068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.063431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.064200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.066320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.077780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad6189fd0154518a4a7cc60ef5b4f85'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:18.078660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad6189fd0154518a4a7cc60ef5b4f85'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:18.089282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 877/1787] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:17 2022] DELETE /identity/v3/users/bad6189fd0154518a4a7cc60ef5b4f85 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:18.090357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.091914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:18.177110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219dcd-db78-42a7-a291-5121c151c3b6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.177568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 911/1788] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:18.184212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.188388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:18.308022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.308775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.309035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.309318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.311467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.315529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.358682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe91e05-e074-4cbf-80e0-da64bc7ec4b5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.359786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 878/1789] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:18.360709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.365635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.367920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.368357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.368936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.370191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.374461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.411511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35813034-0794-4843-8259-df3114bdcb26 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.419067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.420338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.420674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.420952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] PATH_INFO: `/v3/projects/2df90fbec9054af799b3cf2940bf97b9/users/f8bc147e84704367ac4b70a65653160f/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.438690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df90fbec9054af799b3cf2940bf97b9, user_id=f8bc147e84704367ac4b70a65653160f, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.442053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078717e6-3722-4aee-9fb8-6ca745b5347e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.503784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 912/1790] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/users => generated 291 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:18.512517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.527486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42fc3f-2712-4940-81f2-3b7b86ae6f80 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.538278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.538278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.538278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.538278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.538675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.540306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.554946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 913/1791] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:18.556637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.563565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 879/1792] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:18 2022] PUT /identity/v3/projects/2df90fbec9054af799b3cf2940bf97b9/users/f8bc147e84704367ac4b70a65653160f/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:18.569006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8ab138-f383-4989-a84f-6bcabb0cb5ce admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.574998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.575341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.575560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.624922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] MFA Rules not processed for user `f8bc147e84704367ac4b70a65653160f`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:18.626302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:18.642971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.647500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.647500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.647500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.647500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.647500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.658502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 914/1793] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:18.662880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.673203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b39b37d-8836-4a09-8502-20c1fdb8fa11 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.677999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.678913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.679192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.679518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] PATH_INFO: `/v3/projects/22c2be63931042de94bdcc69cbecd641/users/1fb48868fa0b4a2f95d937ecb0fd088a/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.694738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c2be63931042de94bdcc69cbecd641, user_id=1fb48868fa0b4a2f95d937ecb0fd088a, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.696163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 880/1794] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:18.697637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.705698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.711782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce7a34-3e53-4508-8223-9d07e80ce1fd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.716364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.717000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.717305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.717581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.718301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.720185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f9900-dc7e-4ff3-be6f-b6c52b1be68c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:18.785576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 915/1795] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:18 2022] PUT /identity/v3/projects/22c2be63931042de94bdcc69cbecd641/users/1fb48868fa0b4a2f95d937ecb0fd088a/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:18.788394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.789620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:18.820609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 881/1796] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:18.822756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.823219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.823501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.856356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] MFA Rules not processed for user `1fb48868fa0b4a2f95d937ecb0fd088a`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:18.857585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:18.877019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d44d05-47e5-4f2c-92d8-8c98384f1f6d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:18.937098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 882/1797] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:18.937098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:18.950896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:18.951960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:18.952341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:18.952712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] PATH_INFO: `/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:18.954083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbad3ec1e2f44068f18bd16cd0a3456)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:18.956249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.018579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80953b5f-c863-48b1-86e2-2124b5519845 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.027920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.028596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.028894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.029143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.032575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.034546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.065879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbad3ec1e2f44068f18bd16cd0a3456', 'request_id': 'req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:19.072199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbad3ec1e2f44068f18bd16cd0a3456', 'request_id': 'req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:19.077607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbad3ec1e2f44068f18bd16cd0a3456', 'request_id': 'req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:19.111340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 883/1798] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:18 2022] POST /identity/v3/users => generated 291 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:19.112234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.123394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9706a-1bb0-435d-b3a2-695c75cb176f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.134238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] The token cache is being invalidate because project abbad3ec1e2f44068f18bd16cd0a3456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:19.140611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:19.140611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:19.140611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 916/1799] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:18 2022] DELETE /identity/v3/projects/abbad3ec1e2f44068f18bd16cd0a3456 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:19.140611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.140611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.188318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.188998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.189278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.189558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.190805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.192751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31311281-f877-4748-a1b2-4e64cb227019 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.216789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7cf7a-b567-46e9-a9a0-5ff580dd07b3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.221906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.222589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.222983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.223260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.223999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.226183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb2c63-473c-40dd-b12d-212e79d6e498 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.236865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 917/1800] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:19.238194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.238477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.238752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.259326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:19.260564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.268622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 918/1801] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:19.269331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.279201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ae379-08c7-4c24-b09b-999e31757326 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.284186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.284635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 884/1802] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:19.285131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.285484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.285906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] PATH_INFO: `/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5/users/6c7177bc1b5e4878a48d4d7b3540e64e/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.286675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.287082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.288083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.303174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3c8f80df84f8e97e496ef8f751fc5, user_id=6c7177bc1b5e4878a48d4d7b3540e64e, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.306570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.307980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:19.309278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.353790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:19.375292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 885/1803] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:19.376189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.377478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.380775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 919/1804] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:19 2022] PUT /identity/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5/users/6c7177bc1b5e4878a48d4d7b3540e64e/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:19.386786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.390473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda31c1-f88c-4126-bd46-149979b12946 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.445321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8bd57-8d65-47c2-a588-c15255dd4a87 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.447808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.448572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.448828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.449101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.449880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.450295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.450963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.451247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.451524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.451823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.452262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:19.452569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.454211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.469759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 920/1805] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:19.469759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.479410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eec72-0fc6-45e0-9f47-03d6d93b36f2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.484843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.485512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.485837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.486115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.486838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.488446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.500404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 921/1806] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:19.501409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.511295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d4d6d-3093-4004-ad64-eb02b173e64d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.516071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.516761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.517036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.517314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.518066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.522653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.585013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 886/1807] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/users => generated 297 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:19.585013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.595888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5c616-3689-44c9-b7e7-c4861d840cc7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.606203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.607231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.607580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.607946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] PATH_INFO: `/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5/users/6c7177bc1b5e4878a48d4d7b3540e64e/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.610154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e3c8f80df84f8e97e496ef8f751fc5, user_id=6c7177bc1b5e4878a48d4d7b3540e64e, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.612953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.627668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 887/1808] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:19 2022] PUT /identity/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5/users/6c7177bc1b5e4878a48d4d7b3540e64e/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:19.628720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.630739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 922/1809] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:19.642292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.704408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe978a02-a4b6-4fc3-871d-67b53e9e455b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.710652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.711317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693c482-7354-4541-840a-c905cdd7db92 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.711438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.711773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.712147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.712887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.714552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd16f04a-e17f-4cfc-8b46-40e3ddb9df18 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.715395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:19.719128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.719819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.726444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.726444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.726444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.726444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.726760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 888/1810] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:19.727427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.727713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.727990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.757827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] MFA Rules not processed for user `6c7177bc1b5e4878a48d4d7b3540e64e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:19.759131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.831158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 889/1811] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:19.837169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.841354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 923/1812] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:19 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:19.842520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.846867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d556f4-d94f-4147-9e6f-611ac9334aa4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.853091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.858679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9965dd-f6ab-486c-9426-2f9e66b439c8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.858800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.858800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.858800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] PATH_INFO: `/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d/users/55eeef732c0345d284821a994ca3d1f0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.859009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.859101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.859476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.859827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.860630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.862340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.872841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4007fad88e4eddbbbe821ccc5c646d, user_id=55eeef732c0345d284821a994ca3d1f0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.875674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.876225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 924/1813] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:19.885894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.885894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:19.936744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc99c1-38dd-419e-b2e4-34018f21e0aa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.940723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.941367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.941649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.941957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.952231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.953703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.964670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 925/1814] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:19.967567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:19.975946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3d221-c2ca-4722-8d7e-e76ae96eda0b service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:19.982687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:19.983381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:19.983663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:19.983937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:19.984868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:19.986363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:19.998383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 926/1815] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:20.002694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.015137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caf47b-82c6-4f3f-ba01-f036d4f5e992 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.017499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.018651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.018943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.019266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] PATH_INFO: `/v3/projects/8fd2ce61bfb54f55ac3810c3f4e1581e/users/bed5e12b342b485584e50e7fadbdcc5f/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.039953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fd2ce61bfb54f55ac3810c3f4e1581e, user_id=bed5e12b342b485584e50e7fadbdcc5f, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.042879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.050508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 890/1816] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:19 2022] PUT /identity/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d/users/55eeef732c0345d284821a994ca3d1f0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:20.055110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.123160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0626148-ccf0-45d3-95ce-0b5a22ddf4d7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.127979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.128653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.129355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.129355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.129963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.131586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.142068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 891/1817] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:20.147353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.158733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaceb2-60a8-4e39-a6fe-216905e9fa72 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.163342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.164261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.164704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.164979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] PATH_INFO: `/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d/users/55eeef732c0345d284821a994ca3d1f0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.167108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4007fad88e4eddbbbe821ccc5c646d, user_id=55eeef732c0345d284821a994ca3d1f0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.170213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8dd4cb-8c5c-46b0-9bd6-faf4e4e76589 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.180656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 892/1818] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:20 2022] PUT /identity/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d/users/55eeef732c0345d284821a994ca3d1f0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:20.190707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c0c5-3cb0-45b8-aba9-7b42a2bda806 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.194287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c0c5-3cb0-45b8-aba9-7b42a2bda806 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.194287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8358c0c5-3cb0-45b8-aba9-7b42a2bda806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.220121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8358c0c5-3cb0-45b8-aba9-7b42a2bda806 None None] MFA Rules not processed for user `55eeef732c0345d284821a994ca3d1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:20.221362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8358c0c5-3cb0-45b8-aba9-7b42a2bda806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:20.277233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 927/1819] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:20 2022] PUT /identity/v3/projects/8fd2ce61bfb54f55ac3810c3f4e1581e/users/bed5e12b342b485584e50e7fadbdcc5f/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:20.290437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.290437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:20.327477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 893/1820] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:20.327477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.327477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.327477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.366184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] MFA Rules not processed for user `bed5e12b342b485584e50e7fadbdcc5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:20.367319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:20.379165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea7082-4263-4d5b-83c0-7be8bc62893a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.383171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.383915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.384195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.384485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.386448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:20.455297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 894/1821] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:20.456800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.469998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b834fa-36fa-433c-bb28-7d33da0d5631 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.473229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.474619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.477900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.481442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.481442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.481442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.501592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 928/1822] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:20.578410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.579868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.626480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 895/1823] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:20.717206 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:20.727848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c9a6d-c1c1-4b89-a812-bea4cf8fc218 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:20.731716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:20.732392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:20.732704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:20.732982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:20.742554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:20.744179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:20.754426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 929/1824] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:21.449856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:21.460836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587aab84-16b7-497c-873c-f54337d28d91 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:21.465015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:21.465741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:21.466040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:21.466320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:21.468124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:21.532851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:21.534325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:21.543712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 896/1825] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:22.054712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:22.203038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:23.359790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:23.740114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:24.608119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:25.659351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:26.109216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:26.174506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140fe81-6ab9-4a5c-bdbc-68df116e70f8 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:26.180085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:26.180968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.181248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.182533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] PATH_INFO: `/v3/users/f8bc147e84704367ac4b70a65653160f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.183053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bc147e84704367ac4b70a65653160f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:26.188026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:26.189396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:26.200779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5baa1-e37d-486b-a369-7f991c51933c service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:26.210577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:26.212356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.212707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.213050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] PATH_INFO: `/v3/users/bed5e12b342b485584e50e7fadbdcc5f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.214437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bed5e12b342b485584e50e7fadbdcc5f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:26.216522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:26.417108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bed5e12b342b485584e50e7fadbdcc5f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.421430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bc147e84704367ac4b70a65653160f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.430305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bed5e12b342b485584e50e7fadbdcc5f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.437323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bc147e84704367ac4b70a65653160f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.528607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bed5e12b342b485584e50e7fadbdcc5f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.550659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bed5e12b342b485584e50e7fadbdcc5f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.551472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-0908beae-f3d6-4517-8e91-2c15945e9ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bed5e12b342b485584e50e7fadbdcc5f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.559125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 897/1826] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:26 2022] DELETE /identity/v3/users/bed5e12b342b485584e50e7fadbdcc5f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:26.563552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.563919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.564273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.588621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:26.590082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:26.637220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bc147e84704367ac4b70a65653160f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.638140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bc147e84704367ac4b70a65653160f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.647381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-538f34a2-1527-40cd-8175-2c2db1c5157f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bc147e84704367ac4b70a65653160f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:26.661185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 930/1827] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:26 2022] DELETE /identity/v3/users/f8bc147e84704367ac4b70a65653160f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:26.665781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.666152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.666565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.680142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 898/1828] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:26.697106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:26.700331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:26.703511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:26.705369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:26.798760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad99b7-4352-45d3-85a9-a1710c54e51e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:26.808514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 931/1829] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:26.823828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:26.826374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:26.827609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:26.927396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:26.928357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.929871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.930584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.935726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5b54b-2d7c-477d-afc6-a779258fa882 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:26.941868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:26.942542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:26.942660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:26.942824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:26.943247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:26.944556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:26.956812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:26.958239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 899/1830] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:26.958356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:26.970342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 932/1831] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:27.100025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:27.483565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:27.493385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:27.499512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d957d7e-4e0e-4440-af1c-403ee57c257e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:27.504767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:27.505914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:27.506052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:27.506264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] PATH_INFO: `/v3/projects/8fd2ce61bfb54f55ac3810c3f4e1581e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:27.508085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fd2ce61bfb54f55ac3810c3f4e1581e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:27.513329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:27.515052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:27.516758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:27.531718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd0819-f7f5-4060-a4b0-a81a346510b3 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:27.535535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:27.536508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:27.536789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:27.537060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] PATH_INFO: `/v3/projects/2df90fbec9054af799b3cf2940bf97b9` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:27.539050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df90fbec9054af799b3cf2940bf97b9)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:27.541757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:27.684600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df90fbec9054af799b3cf2940bf97b9', 'request_id': 'req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.691108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df90fbec9054af799b3cf2940bf97b9', 'request_id': 'req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.696662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df90fbec9054af799b3cf2940bf97b9', 'request_id': 'req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.700598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fd2ce61bfb54f55ac3810c3f4e1581e', 'request_id': 'req-2efaf950-b1ae-42da-8eca-b550b4138e0e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.706987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fd2ce61bfb54f55ac3810c3f4e1581e', 'request_id': 'req-2efaf950-b1ae-42da-8eca-b550b4138e0e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.784223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] The token cache is being invalidate because project 2df90fbec9054af799b3cf2940bf97b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:27.784500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.785145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.786744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 933/1832] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:27 2022] DELETE /identity/v3/projects/2df90fbec9054af799b3cf2940bf97b9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:27.791180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:27.792547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:27.879031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ab032-c15f-4eab-b5bf-4ac6f9d69c62 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:27.888550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fd2ce61bfb54f55ac3810c3f4e1581e', 'request_id': 'req-2efaf950-b1ae-42da-8eca-b550b4138e0e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.907366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] The token cache is being invalidate because project 8fd2ce61bfb54f55ac3810c3f4e1581e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:27.907897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.908825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2efaf950-b1ae-42da-8eca-b550b4138e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:27.915004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 900/1833] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:27 2022] DELETE /identity/v3/projects/8fd2ce61bfb54f55ac3810c3f4e1581e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:27.916722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7dab0-56e3-4a2f-ac8e-28e4831df4f4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:27.917231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7dab0-56e3-4a2f-ac8e-28e4831df4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:27.917653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7dab0-56e3-4a2f-ac8e-28e4831df4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:27.939604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c5f7dab0-56e3-4a2f-ac8e-28e4831df4f4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:27.941379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c5f7dab0-56e3-4a2f-ac8e-28e4831df4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.033786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 901/1834] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:28.046761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.047045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.047326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.091861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:28.096435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.119676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 902/1835] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:28.121258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.134211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b05751-378d-4d28-8ccc-4f5faaeb9b58 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.139296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.139473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.139963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.140243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.140394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.140497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.140683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.140956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] PATH_INFO: `/v3/users/6c7177bc1b5e4878a48d4d7b3540e64e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.141229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:28.141532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.142243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7177bc1b5e4878a48d4d7b3540e64e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.143639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.144455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.174952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 903/1836] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:28.175439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.187657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0960-b276-4624-a1fe-0799c7d0fb94 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.200557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.201363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.201776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.202143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.204280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.206701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.342252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 904/1837] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:28.346442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.402209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7177bc1b5e4878a48d4d7b3540e64e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:28.427799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7177bc1b5e4878a48d4d7b3540e64e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:28.452961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dff7b-1673-4b2c-9d61-2330721931ad admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.458396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.459733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.460124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.461033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.461868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.463913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.517092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7177bc1b5e4878a48d4d7b3540e64e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:28.517827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7177bc1b5e4878a48d4d7b3540e64e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:28.527028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2542a471-cfd6-4599-9675-11920eab25e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7177bc1b5e4878a48d4d7b3540e64e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:28.534185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 934/1838] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:27 2022] DELETE /identity/v3/users/6c7177bc1b5e4878a48d4d7b3540e64e => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:28.535831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6877b8-e37f-4753-87da-e4aae384fa4b None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.536175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6877b8-e37f-4753-87da-e4aae384fa4b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.536525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6877b8-e37f-4753-87da-e4aae384fa4b None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.538582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 935/1839] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:19:28.551757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.552177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.552588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.570447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 905/1840] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:28.574405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.578604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.583354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:28.584823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.594240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909ed3-e835-4aae-bef9-902d8b7498cf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.616281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:28.672526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.673200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.673482 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.673787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.674590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.676134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.687901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 906/1841] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:28.692084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.703030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34059fdc-f7df-45bb-adb5-39bb82a24a1a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.705047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 936/1842] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:28.707801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.708802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.709006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.709399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.710030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.711663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.718075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.720624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.726113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 907/1843] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:28.727068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.733040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa9088-e251-4f1b-a5f6-14a61855b3b2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.738828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.739477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.743638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.743638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.743836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992992b6-cc40-422b-9e7c-4269c01ae1af admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:28.747180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:28.748123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.748429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.748690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] PATH_INFO: `/v3/projects/75e9213e89cd4818a83f226734d4af75/users/66db281044a34f6cb2aa17cb837ec3c8/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.749902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.751485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf114071-947e-46dc-928c-9d0b97a64a72 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.766193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 937/1844] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:28.770544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75e9213e89cd4818a83f226734d4af75, user_id=66db281044a34f6cb2aa17cb837ec3c8, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:28.773285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:28.848715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 908/1845] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:28 2022] PUT /identity/v3/projects/75e9213e89cd4818a83f226734d4af75/users/66db281044a34f6cb2aa17cb837ec3c8/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:28.859244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:28.859551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:28.859856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:28.887561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] MFA Rules not processed for user `66db281044a34f6cb2aa17cb837ec3c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:28.888773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:28.955264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 938/1846] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:28.960433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:28.968082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:28.999772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.001357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:29.026734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a39e-45cb-4c26-a62f-3d6eadc5cb23 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.031630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.032360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.032641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.032918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.033608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.035601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.080383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69ad20-c660-4fbc-bbdd-7de34f4b470c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.085617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.086959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.087252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.087530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] PATH_INFO: `/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.088754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e3c8f80df84f8e97e496ef8f751fc5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.090769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.137258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 909/1847] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:28 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:29.141510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.218907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e3c8f80df84f8e97e496ef8f751fc5', 'request_id': 'req-b0d86956-e837-40e2-ba12-df7f0d95f88a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:29.231489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f5733-aeea-434e-85e9-21781f851549 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.233260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e3c8f80df84f8e97e496ef8f751fc5', 'request_id': 'req-b0d86956-e837-40e2-ba12-df7f0d95f88a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:29.241333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e3c8f80df84f8e97e496ef8f751fc5', 'request_id': 'req-b0d86956-e837-40e2-ba12-df7f0d95f88a'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:29.293393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.293884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.294169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.294513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.295184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.297175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.313653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] The token cache is being invalidate because project 08e3c8f80df84f8e97e496ef8f751fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:29.313653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:29.313653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b0d86956-e837-40e2-ba12-df7f0d95f88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:29.314942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 939/1848] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:28 2022] DELETE /identity/v3/projects/08e3c8f80df84f8e97e496ef8f751fc5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:29.320540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077f2e-0846-49c9-8306-80ad40f8efa5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.320797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077f2e-0846-49c9-8306-80ad40f8efa5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.321074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57077f2e-0846-49c9-8306-80ad40f8efa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.343756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-57077f2e-0846-49c9-8306-80ad40f8efa5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:29.344968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-57077f2e-0846-49c9-8306-80ad40f8efa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:29.353614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 940/1849] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:29.361385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaae54-1b78-440e-8804-284373a20ade None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.361799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaae54-1b78-440e-8804-284373a20ade None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.362169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aaae54-1b78-440e-8804-284373a20ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.381526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-80aaae54-1b78-440e-8804-284373a20ade None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:29.383384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-80aaae54-1b78-440e-8804-284373a20ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:29.398907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 910/1850] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:29.399971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 941/1851] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:29.402880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.403057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaae54-1b78-440e-8804-284373a20ade None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.404479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-80aaae54-1b78-440e-8804-284373a20ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:29.413521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cae12-7cfb-4ed0-a065-3186990888b9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.416998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aaae54-1b78-440e-8804-284373a20ade None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.418667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.419539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.419831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.422846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.422846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:29.422846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.423146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.423246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.423329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.423329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.423581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.425249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.425881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.436778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 911/1852] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:29.437471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 942/1853] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:29.441384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.441555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.452252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e152ac4-58b6-497b-9273-3c34fc913b1b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.454549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c531eb-eb9c-4a2a-a1bb-cbbb31ab4ab2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.456933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.457577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.457898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.458179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.459148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.459975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.460739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.461084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.461229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.461485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.462303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.464710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.480083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 943/1854] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:29.481059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.491263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30f232-e62d-44f0-b512-e4f52d810455 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.497643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.498586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.502732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.502732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] PATH_INFO: `/v3/projects/cfd1b6ddb082459fa8d7a634ac2a3974/users/b122151abceb4c4d96170831c0a2f903/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.516740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfd1b6ddb082459fa8d7a634ac2a3974, user_id=b122151abceb4c4d96170831c0a2f903, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.519582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602708c-e62c-4086-9104-295f41a67fbb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.560061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 912/1855] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:29.562692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.629035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ff41c-e895-4f22-a1a7-000f5c252e23 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.634455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.635107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.635409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.635684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.636373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.638471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.661755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 944/1856] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:29 2022] PUT /identity/v3/projects/cfd1b6ddb082459fa8d7a634ac2a3974/users/b122151abceb4c4d96170831c0a2f903/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:29.670706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.671120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.671398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.706724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] MFA Rules not processed for user `b122151abceb4c4d96170831c0a2f903`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:29.708011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:29.745508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 913/1857] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:29.748209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.770667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5100a0-976d-4aef-98e3-6cd0ce162fd4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.830153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 945/1858] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:29.831905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.893896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.907860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.908294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.908658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.909633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.912037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.932599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 914/1859] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:29.935016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:29.955070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a6461-d988-422e-99ca-88e2cee78e98 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.963388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.964545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.965078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.965538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.966568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.967164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77362e4d-f120-4dbf-95a4-63ae7c4a7b60 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:29.969050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.972547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:29.973472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:29.973760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:29.974054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:29.975415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:29.978011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:29.985551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 915/1860] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:29.996827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.022840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b51c5f3-3b6a-460b-8907-0be7e3db93c4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.036980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.038644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.039257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.039704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] PATH_INFO: `/v3/projects/1943acf1d25148da9534f7e5b43dfced/users/304d9ac25c1d470dabc42aeb8a2e6c9e/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.063391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1943acf1d25148da9534f7e5b43dfced, user_id=304d9ac25c1d470dabc42aeb8a2e6c9e, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.067259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c1b75-dfe6-4580-ac44-a94f34406971 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.145487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 946/1861] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:29 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:30.146818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.168798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:30.170373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 916/1862] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:29 2022] PUT /identity/v3/projects/1943acf1d25148da9534f7e5b43dfced/users/304d9ac25c1d470dabc42aeb8a2e6c9e/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:30.182417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.182705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.182979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.232220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] MFA Rules not processed for user `304d9ac25c1d470dabc42aeb8a2e6c9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:30.234370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:30.302185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103f163-f76b-418c-8eb8-147abd7d29cb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.392056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 917/1863] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:30.396982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.487123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.488322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.488610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.488885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.489574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.493122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.511652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60835-ae2d-44b4-a9d9-bb368d25d2b4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.518142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.519111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.519739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.520210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.521172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.523993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.627543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:30.641256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 947/1864] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:30 2022] POST /identity/v3/users => generated 294 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:30.642899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.652010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 918/1865] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:30 2022] POST /identity/v3/projects => generated 391 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:30.652010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.656678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59ff78-f0f4-4186-a140-bc5fd0d5499a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.766234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.778317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.778317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.778317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.778317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.778317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.783543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00433bd6-1f75-4233-b540-acbd907bd319 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.789412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.790173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.790455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.790725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.791493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.793483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.797007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 948/1866] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:30.798203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.811576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccfd35f-c8be-46b5-b65e-3be0f46b08f5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.816043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.817066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.817447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.817931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] PATH_INFO: `/v3/projects/7504fab9666149febbde4e73f66affe7/users/408c396a200f41ea90ccca921765cafa/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.835946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7504fab9666149febbde4e73f66affe7, user_id=408c396a200f41ea90ccca921765cafa, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.838741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.917891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 919/1867] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:30 2022] POST /identity/v3/users => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:30.922191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.933130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985c537-000f-4d97-be58-40c48b900c9f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.940379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:30.940379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:30.940379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:30.940379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:30.941206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:30.943135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:30.957919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 920/1868] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:30.962391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:30.973994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 949/1869] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:30 2022] PUT /identity/v3/projects/7504fab9666149febbde4e73f66affe7/users/408c396a200f41ea90ccca921765cafa/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:30.978231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d762631-58e7-42ac-b76d-c9d0e4e6fbfc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:30.978373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.058859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.059724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.060012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.060293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] PATH_INFO: `/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f/users/a65166e33b6c4b6ca8eed28abb74c9a1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.073384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22440a66-f80d-4fc6-822e-b286230de485 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.079475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2780ac1ca3e94b2bb7544044f4a5273f, user_id=a65166e33b6c4b6ca8eed28abb74c9a1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.088865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.089119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.089119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.089119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.089119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.089647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.092108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.107214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 950/1870] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:31.114256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.136854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf54c5-ad5e-4ce1-b8b9-a1858db5cd9a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.142552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.143864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.144132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.144363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] PATH_INFO: `/v3/projects/7504fab9666149febbde4e73f66affe7/users/408c396a200f41ea90ccca921765cafa/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.153058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7504fab9666149febbde4e73f66affe7, user_id=408c396a200f41ea90ccca921765cafa, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.157359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3afd3f-715f-49ab-882c-f9ed67c5e675 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.172211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 951/1871] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:31 2022] PUT /identity/v3/projects/7504fab9666149febbde4e73f66affe7/users/408c396a200f41ea90ccca921765cafa/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:31.183112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.183622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.184286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.217409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] MFA Rules not processed for user `408c396a200f41ea90ccca921765cafa`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:31.219501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:31.231413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 921/1872] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:30 2022] PUT /identity/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f/users/a65166e33b6c4b6ca8eed28abb74c9a1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:31.235188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.306508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3d3c11-ad6a-42af-9e05-fbde3940939b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.309918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 952/1873] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:31.319422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.321946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.322357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.322817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.323129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.323952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.325013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:31.325782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.345323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 922/1874] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:31.346537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.360863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac1ca8-0185-4928-a2f0-5f0d93b60c2b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.371459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.372522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.372805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.373084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] PATH_INFO: `/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f/users/a65166e33b6c4b6ca8eed28abb74c9a1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.375388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2780ac1ca3e94b2bb7544044f4a5273f, user_id=a65166e33b6c4b6ca8eed28abb74c9a1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.378133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cdad8a-4ec2-49f2-9699-7af54befa9e4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.401932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 923/1875] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:31 2022] PUT /identity/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f/users/a65166e33b6c4b6ca8eed28abb74c9a1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:31.410378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.410378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.410378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.410781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ebd1df-b056-4779-95f4-c4c443239ade None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.433751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] MFA Rules not processed for user `a65166e33b6c4b6ca8eed28abb74c9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:31.435076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:31.461326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.462013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.463616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.463616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.464570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:31.506099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 924/1876] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:31.517168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.518748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:31.525572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.527049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.532464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1af8f2-09f3-4265-aa7b-739cf3eeaca2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.535201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.535840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.536194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.536292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 953/1877] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:31.536474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.547743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.549326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.559653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 925/1878] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:31.610935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:31.619337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fc2661-7f17-4c0e-8829-310e8d75c1cc service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:31.623341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:31.623915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:31.624276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:31.624611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:31.685354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:31.686870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182e7569-f13d-41e8-a407-05726a6b82d4 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:31.696552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 954/1879] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:32.636673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:32.824840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:32.826688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:32.915456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc5f5a-881b-4c02-b3cd-adbe452c38ce service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:32.921771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:32.922718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:32.922999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:32.923275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] PATH_INFO: `/v3/users/1fb48868fa0b4a2f95d937ecb0fd088a` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:32.924551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fb48868fa0b4a2f95d937ecb0fd088a)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:32.926622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:33.167480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fb48868fa0b4a2f95d937ecb0fd088a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:33.181553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fb48868fa0b4a2f95d937ecb0fd088a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:33.213510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:33.285636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fb48868fa0b4a2f95d937ecb0fd088a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:33.295944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fb48868fa0b4a2f95d937ecb0fd088a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:33.296749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fb48868fa0b4a2f95d937ecb0fd088a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:33.305680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 926/1880] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:32 2022] DELETE /identity/v3/users/1fb48868fa0b4a2f95d937ecb0fd088a => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:33.310499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:33.310784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:33.311092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:33.331861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:33.332877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:33.414720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 955/1881] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:33.424879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:33.426451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:33.487947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2251ea-abba-41c9-bb3d-0eb0100bb740 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:33.492102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:33.492757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:33.493038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:33.493309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:33.502859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:33.504438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:33.515262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 927/1882] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:34.411089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:34.412716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:34.429875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3a052-b1e0-47df-bd95-150a966029d8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:34.435322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:34.436199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:34.437056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:34.437507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] PATH_INFO: `/v3/projects/22c2be63931042de94bdcc69cbecd641` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:34.441073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c2be63931042de94bdcc69cbecd641)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:34.443988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:34.632899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c2be63931042de94bdcc69cbecd641', 'request_id': 'req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:34.640690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c2be63931042de94bdcc69cbecd641', 'request_id': 'req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:34.649640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c2be63931042de94bdcc69cbecd641', 'request_id': 'req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:34.765335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] The token cache is being invalidate because project 22c2be63931042de94bdcc69cbecd641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:34.765992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:34.777664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:34.782303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 956/1883] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:34 2022] DELETE /identity/v3/projects/22c2be63931042de94bdcc69cbecd641 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:34.786202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:34.800818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6172387-6446-4dc0-825e-6274efbfed4b service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:34.878913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:34.880763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:34.925866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:34.927045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:34.927748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:34.929418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:34.945545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] PATH_INFO: `/v3/users/55eeef732c0345d284821a994ca3d1f0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:34.945545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55eeef732c0345d284821a994ca3d1f0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:34.945545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:34.958658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ba67-3e58-488a-a2ec-2097da7ae8f6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:34.965310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:34.970406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:34.970783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:34.971066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:34.973426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:35.063036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:35.064554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:35.084762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 957/1884] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:35.177571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55eeef732c0345d284821a994ca3d1f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:35.201615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55eeef732c0345d284821a994ca3d1f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:35.270180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55eeef732c0345d284821a994ca3d1f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:35.279460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55eeef732c0345d284821a994ca3d1f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:35.280212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-deba822c-2025-4fa4-b6af-4c3bf84a0f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55eeef732c0345d284821a994ca3d1f0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:35.287080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 928/1885] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:34 2022] DELETE /identity/v3/users/55eeef732c0345d284821a994ca3d1f0 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:35.293778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:35.954729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:35.957059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:35.978310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876736ea-dfa3-4021-ac66-a7c4c9195b2e service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:36.055575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:36.060765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.062194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.062636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] PATH_INFO: `/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.064702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4007fad88e4eddbbbe821ccc5c646d)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:36.066909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:36.237485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4007fad88e4eddbbbe821ccc5c646d', 'request_id': 'req-faf77c1e-037e-44fb-b910-1e3330cc49d6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:36.244790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4007fad88e4eddbbbe821ccc5c646d', 'request_id': 'req-faf77c1e-037e-44fb-b910-1e3330cc49d6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:36.251483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4007fad88e4eddbbbe821ccc5c646d', 'request_id': 'req-faf77c1e-037e-44fb-b910-1e3330cc49d6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:36.337896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] The token cache is being invalidate because project ce4007fad88e4eddbbbe821ccc5c646d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:36.338374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:36.342497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-faf77c1e-037e-44fb-b910-1e3330cc49d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:36.347476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 958/1886] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:35 2022] DELETE /identity/v3/projects/ce4007fad88e4eddbbbe821ccc5c646d => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:36.349273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.349773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.350170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.391323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:36.392439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:36.541878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 929/1887] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:36.542534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.542889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.543233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.601550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:36.603941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:36.618584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 959/1888] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:36.620468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:36.633224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd885e7-d397-4895-bc7a-6a07e529a49b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:36.641522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:36.642242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.642525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.642808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.643551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:36.643861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:36.645848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:36.668365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 930/1889] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:36.670233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:36.691580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd981eb-4eed-46fb-8c41-68b2a536b769 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:36.697043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:36.697827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.698113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.698391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.699098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:36.701262 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:36.747474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:36.749308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:36.798144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 960/1890] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:36 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:36.802518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:36.812295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea742a5-143a-4903-b41e-c07d9c3c4ddf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:36.871177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:36.872031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.872302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.872496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.875488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45138c-a565-4b98-ab40-b32517839b30 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:36.876951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:36.885886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:36.888197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:36.889303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:36.889640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:36.890477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:36.892755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:36.962148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:36.963104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:36.974541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 931/1891] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:37.019480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 961/1892] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:36 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:37.023656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.034143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc9fc8-8acf-484a-b4c1-457ee104e7bc service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.038944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.039604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.040113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.040229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.040917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.042548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.052958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 932/1893] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:37.058160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.067990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc2bc2-f44e-4097-834f-115de06b5b56 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.075130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.075813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.076095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.079690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.079690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.079690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d81d10-56fc-48c4-9a17-a53655039a4b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.090835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 962/1894] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:37.094921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.105181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f317415-7c6d-4185-ae9b-361d5df6ac5f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.110291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.111243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.111522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.111843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] PATH_INFO: `/v3/projects/0273144082f247649ff3f866a6bdb759/users/456b7fd9d401400cae3df677a41af05c/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.129630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0273144082f247649ff3f866a6bdb759, user_id=456b7fd9d401400cae3df677a41af05c, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.133625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.139658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:37.262578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 933/1895] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:37 2022] PUT /identity/v3/projects/0273144082f247649ff3f866a6bdb759/users/456b7fd9d401400cae3df677a41af05c/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:37.266535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.266959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.267487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.306066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] MFA Rules not processed for user `456b7fd9d401400cae3df677a41af05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:37.307354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:37.393120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 963/1896] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:37.397917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.472769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6336216-dbac-418b-9b04-b73b92a5beb9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.478236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.478907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.479186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.479457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.480156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.482229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.588315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 934/1897] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:37 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:37.592377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.603929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe7dc0-1ed5-4ef1-9bb7-6fd3e287be94 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.700264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.701203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.701661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.702139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.703127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.705272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.793566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 964/1898] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:37 2022] POST /identity/v3/users => generated 294 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:37.794835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.798586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:37.807977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df20ee-868e-4b0e-99e6-f46b7b487d47 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.812923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.813622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.814015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.814297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.815058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.818717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.830244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 935/1899] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:37.834531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.845823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aed76f-a739-4ea2-ad27-2d217e5ed543 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.851646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.852309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.852599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.852880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.855626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.855626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75c280-935e-4b37-96d4-3a1e55b9eaed admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:37.866908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 965/1900] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:37.871350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:37.882322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2988d63-5181-4a87-9a03-82954d3ee38d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:37.887412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:37.888303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:37.888585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:37.888861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] PATH_INFO: `/v3/projects/6bd06b5624374eb1b60ef118d76e4d74/users/8ef363062bbf4e6ba4aa4cccaa735e71/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:37.922626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd06b5624374eb1b60ef118d76e4d74, user_id=8ef363062bbf4e6ba4aa4cccaa735e71, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:37.927649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.065079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 936/1901] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:37 2022] PUT /identity/v3/projects/6bd06b5624374eb1b60ef118d76e4d74/users/8ef363062bbf4e6ba4aa4cccaa735e71/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:38.076209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.076712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.076817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.104369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] MFA Rules not processed for user `8ef363062bbf4e6ba4aa4cccaa735e71`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:38.105592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:38.171301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 966/1902] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:38.175623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.237557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49dcf2-a6b6-4649-8154-af0d940688ac admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.242785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.243442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.243718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.243988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.244665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.246592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.369885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 937/1903] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:38 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:38.374289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.384991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a302db0-df96-4a67-a919-b0504e2a75bd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.422532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.424283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:38.475239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.476608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.476876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.477204 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.477937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.480043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.500366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddaa757-cb03-4ce2-b8a4-e9a988745448 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.505559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.506559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.506840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.507107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] PATH_INFO: `/v3/users/304d9ac25c1d470dabc42aeb8a2e6c9e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.508933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=304d9ac25c1d470dabc42aeb8a2e6c9e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.510974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.613466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 967/1904] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:38 2022] POST /identity/v3/users => generated 296 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:38.617385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.627376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880a43f-03fd-4865-b576-a0c5b71d56ac admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.632029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.632828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.633099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.633291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.634087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.635736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.646036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 968/1905] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:38.654872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.667150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23649c33-8270-4fc3-a9e0-59085b7e6223 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.684585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.685500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.685809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.689762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] PATH_INFO: `/v3/projects/b5fbca940ca044a89d5637f6b084553e/users/807dcb10de9a41bd9c5d04339764760f/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.719694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fbca940ca044a89d5637f6b084553e, user_id=807dcb10de9a41bd9c5d04339764760f, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.723774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.830747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 969/1906] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:38 2022] PUT /identity/v3/projects/b5fbca940ca044a89d5637f6b084553e/users/807dcb10de9a41bd9c5d04339764760f/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:38.836218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.860722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304d9ac25c1d470dabc42aeb8a2e6c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:38.876330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304d9ac25c1d470dabc42aeb8a2e6c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:38.922265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e196fb-d12e-4760-83dd-7dbcd031a5a5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.927383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.928071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.931448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.931448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.931448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.932245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.943146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 970/1907] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:38.950777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:38.962667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48053fb8-67f2-4880-a648-71702d952d80 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:38.969598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:38.970536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:38.970818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:38.971099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] PATH_INFO: `/v3/projects/b5fbca940ca044a89d5637f6b084553e/users/807dcb10de9a41bd9c5d04339764760f/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:38.973295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5fbca940ca044a89d5637f6b084553e, user_id=807dcb10de9a41bd9c5d04339764760f, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:38.976600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0542a-cbea-484a-8254-b0fa026e60c5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:38.978873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304d9ac25c1d470dabc42aeb8a2e6c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:38.990169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304d9ac25c1d470dabc42aeb8a2e6c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:38.991667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-97756d03-6a42-4938-afe7-98d8d075bc2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304d9ac25c1d470dabc42aeb8a2e6c9e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:38.997829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 971/1908] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:38 2022] PUT /identity/v3/projects/b5fbca940ca044a89d5637f6b084553e/users/807dcb10de9a41bd9c5d04339764760f/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:39.002186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:39.002629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:39.003000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 938/1909] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:38 2022] DELETE /identity/v3/users/304d9ac25c1d470dabc42aeb8a2e6c9e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:39.003230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:39.004607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:39.004892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:39.005545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:39.023742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:39.025030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:39.050455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] MFA Rules not processed for user `807dcb10de9a41bd9c5d04339764760f`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:39.051858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:39.126832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 939/1910] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:39.137535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:39.139579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:39.143352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 972/1911] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:39.151848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:39.154115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:39.239402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62af33e-2196-4f46-8dfb-32ccf6b45b16 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:39.243832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:39.245004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:39.245004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:39.245210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:39.245319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a6f11-b803-4b44-9a53-f541bf5deb5e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:39.249060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:39.251307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:39.251307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:39.251307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:39.255822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:39.257541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:39.260910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:39.262389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:39.268681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 973/1912] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:39.274609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 940/1913] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:39.323404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:39.478802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:39.700862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:39.703209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:39.748998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a547-ec5f-4d70-83c7-5e9b58e2ebd7 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:39.760220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:39.762289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:39.762807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:39.763277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] PATH_INFO: `/v3/projects/1943acf1d25148da9534f7e5b43dfced` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:39.786744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1943acf1d25148da9534f7e5b43dfced)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:39.788749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:39.936784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1943acf1d25148da9534f7e5b43dfced', 'request_id': 'req-825b7719-1bfe-405b-b058-11d4528dd7f1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:39.946581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1943acf1d25148da9534f7e5b43dfced', 'request_id': 'req-825b7719-1bfe-405b-b058-11d4528dd7f1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:39.954117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1943acf1d25148da9534f7e5b43dfced', 'request_id': 'req-825b7719-1bfe-405b-b058-11d4528dd7f1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.050133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] The token cache is being invalidate because project 1943acf1d25148da9534f7e5b43dfced was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:40.050133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.051275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.053994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 974/1914] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:39 2022] DELETE /identity/v3/projects/1943acf1d25148da9534f7e5b43dfced => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:40.058549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:40.068260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43fff2-20bf-4693-9b25-4c2274f4f328 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:40.133285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:40.135191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:40.137195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:40.137195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] PATH_INFO: `/v3/users/a65166e33b6c4b6ca8eed28abb74c9a1` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:40.137799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65166e33b6c4b6ca8eed28abb74c9a1)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:40.140060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:40.385813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65166e33b6c4b6ca8eed28abb74c9a1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.401580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65166e33b6c4b6ca8eed28abb74c9a1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.510315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65166e33b6c4b6ca8eed28abb74c9a1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.520072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65166e33b6c4b6ca8eed28abb74c9a1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.521525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65166e33b6c4b6ca8eed28abb74c9a1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:40.530938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 941/1915] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:40 2022] DELETE /identity/v3/users/a65166e33b6c4b6ca8eed28abb74c9a1 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:40.714026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:40.715584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:40.757429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:40.792459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825b7719-1bfe-405b-b058-11d4528dd7f1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:40.866716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:40.868584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:40.869639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:40.870730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:40.878303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:40.879760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:40.978866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:40.980435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858cc293-27ac-45ff-971d-375252160415 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:40.997916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 975/1916] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:41.121259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:41.122920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:41.220325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be859018-e9bf-47b3-9467-d00f4009ff5c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:41.227443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:41.228584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.229663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.230151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] PATH_INFO: `/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.231667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2780ac1ca3e94b2bb7544044f4a5273f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:41.234017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:41.354519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2780ac1ca3e94b2bb7544044f4a5273f', 'request_id': 'req-e74b5a7b-033f-4017-ab55-05195b584664'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:41.366568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2780ac1ca3e94b2bb7544044f4a5273f', 'request_id': 'req-e74b5a7b-033f-4017-ab55-05195b584664'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:41.475776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2780ac1ca3e94b2bb7544044f4a5273f', 'request_id': 'req-e74b5a7b-033f-4017-ab55-05195b584664'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:41.492167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] The token cache is being invalidate because project 2780ac1ca3e94b2bb7544044f4a5273f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:41.492459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:41.501458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e74b5a7b-033f-4017-ab55-05195b584664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:41.503438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 942/1917] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:41 2022] DELETE /identity/v3/projects/2780ac1ca3e94b2bb7544044f4a5273f => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:41.508975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.509264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.509543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.528584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:41.529777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:41.593498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 976/1918] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:41.601441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.601743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.602032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.622185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:41.623426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:41.641844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 943/1919] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:41.643405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:41.658712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a35aeb-246c-4394-9245-2ac73bed6ccf None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:41.666998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:41.668157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.668707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.669220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.670233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:41.670785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:41.672789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:41.705599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 977/1920] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:41.708968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:41.724811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e72c8-93bd-4006-a987-7a70f614e533 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:41.731694 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:41.732820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.733172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.733681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.734476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:41.736671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:41.873346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 944/1921] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:41 2022] POST /identity/v3/projects => generated 371 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:41.878171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:41.888512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aead6d-3196-4912-aa83-c1f390bd1198 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:41.955834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:41.956547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:41.956830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:41.957160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:41.958303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:41.960806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:42.032060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 978/1922] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:41 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:42.036696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:42.060368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f935d-4776-48c4-802a-91ec48a62977 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:42.060368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:42.060368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:42.060368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:42.060848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:42.060848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:42.061373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:42.072926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 945/1923] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:42.077337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:42.090169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f70944-03b0-4905-8320-eb9f0f7244f9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:42.094041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:42.097091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:42.098016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:42.098443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:42.098868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:42.099741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:42.102221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bd38a-4c43-4e7e-b5d5-3c94ac6d6ab9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:42.119189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 979/1924] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:42.120858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:42.132446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585067c-c5b9-46ca-8950-11c3b14839fd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:42.138500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:42.139398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:42.139669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:42.140485 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] PATH_INFO: `/v3/projects/c7219d9790404986b60d60df5e23a6cb/users/f2353d064cbf4c2d896a4e7dfb6b35b7/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:42.157969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7219d9790404986b60d60df5e23a6cb, user_id=f2353d064cbf4c2d896a4e7dfb6b35b7, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:42.160719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:42.178216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:42.244200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 946/1925] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:42 2022] PUT /identity/v3/projects/c7219d9790404986b60d60df5e23a6cb/users/f2353d064cbf4c2d896a4e7dfb6b35b7/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:42.249230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:42.249481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:42.249790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:42.268193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:42.269471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:42.333324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 980/1926] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:42.345144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:42.346959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:42.409252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a501f09-ca80-4d97-a1bd-b6a6112e56d0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:42.414029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:42.414772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:42.415129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:42.415477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:42.425929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:42.427513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b301c13-13e6-4dcb-b34c-90d5e9aa3034 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:42.438545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 947/1927] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:42.738954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:43.088970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:43.091329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:43.102543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21020-bc57-42f9-89d8-36b7413077ce None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:43.107574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:43.108473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:43.108750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:43.109021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] PATH_INFO: `/v3/users/66db281044a34f6cb2aa17cb837ec3c8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:43.110389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=66db281044a34f6cb2aa17cb837ec3c8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:43.112371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:43.293658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:43.351807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66db281044a34f6cb2aa17cb837ec3c8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:43.369653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66db281044a34f6cb2aa17cb837ec3c8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:43.436061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66db281044a34f6cb2aa17cb837ec3c8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:43.436669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66db281044a34f6cb2aa17cb837ec3c8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:43.445107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66db281044a34f6cb2aa17cb837ec3c8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:43.453326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 981/1928] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:43 2022] DELETE /identity/v3/users/66db281044a34f6cb2aa17cb837ec3c8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:43.457785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:43.458556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:43.458860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:43.479197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:43.480477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:43.547860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 948/1929] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:43.556945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:43.558618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:43.625801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fdc590-d990-43bb-ad75-d0c3273bfb5f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:43.631278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:43.631938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:43.632222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:43.632501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:43.643859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:43.645294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18ecd5-90d0-4f00-bebe-d0b1d874c9a6 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:43.655608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 982/1930] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:44.112499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.114835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:44.143238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d325b-3f04-4ae8-a85b-95dbe01c72b1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.149354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.150526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.150898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.151365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] PATH_INFO: `/v3/projects/75e9213e89cd4818a83f226734d4af75` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.153562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75e9213e89cd4818a83f226734d4af75)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.156053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:44.202110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.204564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.205065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.249056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] MFA Rules not processed for user `f2353d064cbf4c2d896a4e7dfb6b35b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:44.251094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:44.330275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75e9213e89cd4818a83f226734d4af75', 'request_id': 'req-d8053f9a-0501-4f86-8061-5a72bb849bb0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.340110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 983/1931] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:44.342049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.343969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:44.345757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75e9213e89cd4818a83f226734d4af75', 'request_id': 'req-d8053f9a-0501-4f86-8061-5a72bb849bb0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.401771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72a341-73ad-4d94-80ab-3079e56dff28 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.410852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75e9213e89cd4818a83f226734d4af75', 'request_id': 'req-d8053f9a-0501-4f86-8061-5a72bb849bb0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.426151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] The token cache is being invalidate because project 75e9213e89cd4818a83f226734d4af75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:44.426448 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.427183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.432481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 949/1932] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:44 2022] DELETE /identity/v3/projects/75e9213e89cd4818a83f226734d4af75 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:44.433672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.437104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:44.558926 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.559603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.559883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.560161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.560862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.562827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:44.577978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8053f9a-0501-4f86-8061-5a72bb849bb0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.590838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.591894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.592337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.592767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] PATH_INFO: `/v3/users/b122151abceb4c4d96170831c0a2f903` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.594218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b122151abceb4c4d96170831c0a2f903)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.596655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:44.635894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:44.690758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 984/1933] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:44 2022] POST /identity/v3/projects => generated 371 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:44.696165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.697901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:44.766242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e5243-0a8d-4fe2-8134-193d13336014 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.771099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.771790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.772073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.772344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.773031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.775044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:44.792377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b122151abceb4c4d96170831c0a2f903'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.804270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b122151abceb4c4d96170831c0a2f903'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.836061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:44.843697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 985/1934] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:44 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:19:44.847911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.859063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3138b-6588-413c-bbd5-4a28a3965201 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.864126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.864878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.866627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.866627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.866802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.878972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:44.879557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 986/1935] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:44.883243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:44.893038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96d9b3-8226-48b2-94b9-f137edf64e9f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:44.897685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:44.898600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:44.898730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b122151abceb4c4d96170831c0a2f903'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.898898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:44.899152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] PATH_INFO: `/v3/projects/16d2a4c66d074b21832bb5db89c16fbf/users/50fc72f450ab4784935ed5b0554d628e/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:44.906913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b122151abceb4c4d96170831c0a2f903'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.907804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b122151abceb4c4d96170831c0a2f903'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:44.917792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 950/1936] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:44 2022] DELETE /identity/v3/users/b122151abceb4c4d96170831c0a2f903 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:44.920458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d2a4c66d074b21832bb5db89c16fbf, user_id=50fc72f450ab4784935ed5b0554d628e, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:44.923305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:45.064293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 987/1937] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:44 2022] PUT /identity/v3/projects/16d2a4c66d074b21832bb5db89c16fbf/users/50fc72f450ab4784935ed5b0554d628e/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:45.068266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:45.069713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:45.141461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb749a-c7b4-4566-8bd6-35de29266f13 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:45.243115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:45.243794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:45.244124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:45.244405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:45.245190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:45.247311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:45.258111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 951/1938] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:45.262411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:45.273567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58871570-4ee6-4ee6-b113-adb0cca678f1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:45.285095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:45.286205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:45.286559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:45.286908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] PATH_INFO: `/v3/projects/16d2a4c66d074b21832bb5db89c16fbf/users/50fc72f450ab4784935ed5b0554d628e/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:45.289962 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d2a4c66d074b21832bb5db89c16fbf, user_id=50fc72f450ab4784935ed5b0554d628e, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:45.292728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:45.306333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 988/1939] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:45 2022] PUT /identity/v3/projects/16d2a4c66d074b21832bb5db89c16fbf/users/50fc72f450ab4784935ed5b0554d628e/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:45.451395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:45.456526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:45.489264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c554b8c-3dcf-4768-8b0c-2d27fec5dd5e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:45.556411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:45.557282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:45.557567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:45.557902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] PATH_INFO: `/v3/projects/cfd1b6ddb082459fa8d7a634ac2a3974` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:45.559084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfd1b6ddb082459fa8d7a634ac2a3974)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:45.561001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:45.765227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfd1b6ddb082459fa8d7a634ac2a3974', 'request_id': 'req-25ce726d-4324-4193-8972-9dc52ebfb877'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:45.773961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfd1b6ddb082459fa8d7a634ac2a3974', 'request_id': 'req-25ce726d-4324-4193-8972-9dc52ebfb877'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:45.846690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfd1b6ddb082459fa8d7a634ac2a3974', 'request_id': 'req-25ce726d-4324-4193-8972-9dc52ebfb877'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:45.861757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] The token cache is being invalidate because project cfd1b6ddb082459fa8d7a634ac2a3974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:45.862059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:45.863300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-25ce726d-4324-4193-8972-9dc52ebfb877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:45.869664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:45.872853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:45.875610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 952/1940] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:45 2022] DELETE /identity/v3/projects/cfd1b6ddb082459fa8d7a634ac2a3974 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:45.894884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac436fe-f457-4ae9-b7fd-926c6665a9fe admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:45.955153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:45.955966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:45.956254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:45.956527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] PATH_INFO: `/v3/users/408c396a200f41ea90ccca921765cafa` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:45.958013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] RBAC: Authorizing `identity:delete_user(user_id=408c396a200f41ea90ccca921765cafa)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:45.960487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:46.204915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '408c396a200f41ea90ccca921765cafa'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:46.223021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '408c396a200f41ea90ccca921765cafa'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:46.298390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '408c396a200f41ea90ccca921765cafa'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:46.299486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '408c396a200f41ea90ccca921765cafa'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:46.308346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '408c396a200f41ea90ccca921765cafa'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:46.321368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 989/1941] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:45 2022] DELETE /identity/v3/users/408c396a200f41ea90ccca921765cafa => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:46.577676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:46.658531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:46.777506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46a15-5e52-42c4-8ce6-40cf03548f36 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:46.778222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46a15-5e52-42c4-8ce6-40cf03548f36 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:46.779100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de46a15-5e52-42c4-8ce6-40cf03548f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:46.822517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3de46a15-5e52-42c4-8ce6-40cf03548f36 None None] MFA Rules not processed for user `50fc72f450ab4784935ed5b0554d628e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:46.823918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3de46a15-5e52-42c4-8ce6-40cf03548f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:46.888851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:46.890324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:46.943365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 953/1942] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:46.960838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:46.961508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:46.962015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:46.987130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] MFA Rules not processed for user `f2353d064cbf4c2d896a4e7dfb6b35b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:46.988666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:46.992938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71f2b-a95a-4534-b23f-dca1d033874d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.004978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.006960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.008190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.009036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] PATH_INFO: `/v3/projects/7504fab9666149febbde4e73f66affe7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.010919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7504fab9666149febbde4e73f66affe7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.013689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.056050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 954/1943] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:47.063398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.065311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.168257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7504fab9666149febbde4e73f66affe7', 'request_id': 'req-b16e9dca-5a40-4b85-b1f8-47550d43bf67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:47.178823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7504fab9666149febbde4e73f66affe7', 'request_id': 'req-b16e9dca-5a40-4b85-b1f8-47550d43bf67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:47.187118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7504fab9666149febbde4e73f66affe7', 'request_id': 'req-b16e9dca-5a40-4b85-b1f8-47550d43bf67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:47.249212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] The token cache is being invalidate because project 7504fab9666149febbde4e73f66affe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:47.249741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:47.254362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b16e9dca-5a40-4b85-b1f8-47550d43bf67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:47.254476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 990/1944] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:46 2022] DELETE /identity/v3/projects/7504fab9666149febbde4e73f66affe7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:47.260910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea6bb-6d72-47d6-b88e-1a9ce1b6815d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.261199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea6bb-6d72-47d6-b88e-1a9ce1b6815d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.261473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea6bb-6d72-47d6-b88e-1a9ce1b6815d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.264255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab8e09-be65-48d0-a58c-37a87c979c9a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.303816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-137ea6bb-6d72-47d6-b88e-1a9ce1b6815d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:47.306623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-137ea6bb-6d72-47d6-b88e-1a9ce1b6815d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.355569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:47.439401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.440070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.440349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.441798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.447858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:47.448995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.459020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 991/1945] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:47.470940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.471234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.471503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.493119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:47.498332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.516627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 992/1946] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:47.518136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.519978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.533311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.534849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.544733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 955/1947] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:47.559797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.571763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e0b22-96ba-4634-9554-4edc20acb243 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.576461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.577132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.577415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.577691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.578611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:47.578924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.580634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.595334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e851477-6f73-4c6e-9c35-14636654ad7f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.597115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 956/1948] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:47.600866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.600866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.601104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.601350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.604902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:47.609992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.620907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7712c-b6d2-4ad5-865e-dcc44caa15fb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.626589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.627327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.627747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.628093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.628848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.630873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.678780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.680261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.698803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 993/1949] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:47.712715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 957/1950] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:47 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:47.717506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.730147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ffae-8a52-4cb7-943e-9d15dc33114a service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.804775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.806094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.806752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.806876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.807732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.809923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.835717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:47.885897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 994/1951] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:47 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:47.887444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.899709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2573f1e-5da2-4789-8939-81014434993f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.907337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.912041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.912041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.915664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.918531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.921915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.941595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 958/1952] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:47.942608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.954323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a405c16-78d1-45ce-8ef8-34aba32e802e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.959452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.960129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.960420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.960725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:47.961457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:47.963102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1713de6a-bdb3-464a-8e84-70898a30edfb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:47.974524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 995/1953] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:47.979351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:47.992406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d09c61-268c-4531-97b1-b0d9e1cf7a06 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:47.997326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:47.998274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:47.998598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:47.998851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] PATH_INFO: `/v3/projects/94fbc4a336754736972b57e2b5efb99e/users/ac3209d6d92a4ec3b94355e2508ef6a8/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:48.024970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94fbc4a336754736972b57e2b5efb99e, user_id=ac3209d6d92a4ec3b94355e2508ef6a8, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:48.027693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:48.120909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 959/1954] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:47 2022] PUT /identity/v3/projects/94fbc4a336754736972b57e2b5efb99e/users/ac3209d6d92a4ec3b94355e2508ef6a8/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:48.132924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:48.132924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:48.133847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:48.179059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:48.186681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] MFA Rules not processed for user `ac3209d6d92a4ec3b94355e2508ef6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:48.187914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:48.294985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 996/1955] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:48.436324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:48.437945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:48.573221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767b7e2-381b-4a47-9ece-b864d2bde8e3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:48.579590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:48.580791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:48.581210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:48.581675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:48.647268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:48.647268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee56214b-f886-41f8-911c-9d5ec4ba8f75 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:48.647268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 960/1956] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:48.649291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:48.749176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d8d646-0ea4-489b-ab50-378876a37d59 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:48.749176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:48.749176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:48.749176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:48.749806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] PATH_INFO: `/v3/users/ac3209d6d92a4ec3b94355e2508ef6a8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:48.749806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3209d6d92a4ec3b94355e2508ef6a8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:48.749806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:49.195225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3209d6d92a4ec3b94355e2508ef6a8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:49.236894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3209d6d92a4ec3b94355e2508ef6a8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:49.309464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3209d6d92a4ec3b94355e2508ef6a8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:49.310284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3209d6d92a4ec3b94355e2508ef6a8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:49.318263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3209d6d92a4ec3b94355e2508ef6a8'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:49.347255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 997/1957] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:48 2022] DELETE /identity/v3/users/ac3209d6d92a4ec3b94355e2508ef6a8 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:49.347660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:49.348108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:49.348410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:49.365888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:49.368552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:49.489277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 961/1958] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:49.507087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:49.508839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:49.613743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2eb2-48a7-4751-ab35-ecc1fbe37e08 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:49.619023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:49.620215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:49.620215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:49.620612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:49.631763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:49.633420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ead74-2c45-4bed-ada0-7ad89fec0e06 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:49.646527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 998/1959] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:50.163078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:50.164809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:50.178517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed9d45-12cc-420a-b43e-52c9743ff3e8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:50.186613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:50.187860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.188288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.188715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] PATH_INFO: `/v3/projects/94fbc4a336754736972b57e2b5efb99e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.190260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94fbc4a336754736972b57e2b5efb99e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:50.192377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:50.305393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fbc4a336754736972b57e2b5efb99e', 'request_id': 'req-9a68ef30-f287-488a-a08a-761f5b283fa4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:50.312716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fbc4a336754736972b57e2b5efb99e', 'request_id': 'req-9a68ef30-f287-488a-a08a-761f5b283fa4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:50.406698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fbc4a336754736972b57e2b5efb99e', 'request_id': 'req-9a68ef30-f287-488a-a08a-761f5b283fa4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:50.420932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] The token cache is being invalidate because project 94fbc4a336754736972b57e2b5efb99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:50.421297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:50.421989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9a68ef30-f287-488a-a08a-761f5b283fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:50.423655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 962/1960] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:50 2022] DELETE /identity/v3/projects/94fbc4a336754736972b57e2b5efb99e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:50.429025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.429533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.429649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.448065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:50.449339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:50.492666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:50.511748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 999/1961] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:50.519601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.519893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.520174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.546062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:50.547463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:50.557653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 963/1962] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:50.562003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:50.573416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb5367-5ceb-4b41-8ac8-a32938e84c57 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:50.581987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:50.583178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.583729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.584855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.586724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:50.587338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:50.587849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:50.589555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:50.602309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1000/1963] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:19:50.606794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:50.616600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25bed2-a877-4822-a8fb-bb0236d4abe3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:50.621330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:50.622034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.622317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.622590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.623293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:50.625188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:50.755908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 964/1964] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:50 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:50.760258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:50.772121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf9063-f839-4d49-a054-2218749e2518 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:50.835450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:50.836166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.836448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.836772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.837404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:50.839604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:50.972726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1001/1965] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:50 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:50.978340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:50.993631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7c1d2b-b1fa-46f8-abdf-172179a8e846 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:50.996516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:50.997190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:50.997510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:50.997768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:50.998511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:51.000185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:51.011691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 965/1966] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:51.016585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:51.027731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6f95d-9dc0-4163-b612-16d5471bb5c6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:51.032570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:51.033368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:51.033598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:51.033925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:51.039268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:51.039268 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424ac88-bbbc-4feb-955a-2219df18ea47 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:51.046894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1002/1967] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:51.051071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:51.063573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2907b8-14e6-4e4e-ad9c-891870593b41 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:51.069175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:51.076762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:51.076762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:51.076762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] PATH_INFO: `/v3/projects/20199841e2764e499c24b7933d7878d9/users/e63c56eb2f5944d88ea4521fad5294d4/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:51.087110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20199841e2764e499c24b7933d7878d9, user_id=e63c56eb2f5944d88ea4521fad5294d4, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:51.090170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:51.145690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 966/1968] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:51 2022] PUT /identity/v3/projects/20199841e2764e499c24b7933d7878d9/users/e63c56eb2f5944d88ea4521fad5294d4/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:51.152752 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:51.153636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:51.157370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:51.174112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:51.175894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:51.247059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1003/1969] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:51.257354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:51.259117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:51.315442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df4645-de00-4b89-b2d7-72b8b22b78e4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:51.319904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:51.320586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:51.320872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:51.321152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:51.331096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:51.332822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4626038-17cb-432e-a475-7d65b2212afb service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:51.342530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 967/1970] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:52.151695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:52.652961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:52.836283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:52.837794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:52.853626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cd186-fb79-4e3f-ad6f-ee7997afb066 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:52.859429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:52.860883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:52.861355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:52.861936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] PATH_INFO: `/v3/users/456b7fd9d401400cae3df677a41af05c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:52.864031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=456b7fd9d401400cae3df677a41af05c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:52.866553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:53.206419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:53.206699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:53.206972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:53.236569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '456b7fd9d401400cae3df677a41af05c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:53.242369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] MFA Rules not processed for user `e63c56eb2f5944d88ea4521fad5294d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:53.244090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:53.251434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '456b7fd9d401400cae3df677a41af05c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:53.328515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 968/1971] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:53.340336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:53.342027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:53.366838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '456b7fd9d401400cae3df677a41af05c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:53.367371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '456b7fd9d401400cae3df677a41af05c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:53.377612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d140171b-52ad-48ca-8aaf-cee93db10240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '456b7fd9d401400cae3df677a41af05c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:53.389902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1004/1972] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:52 2022] DELETE /identity/v3/users/456b7fd9d401400cae3df677a41af05c => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:53.396377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:53.397640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:53.397640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:53.410592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00255b17-0416-42d4-8cb4-d6ec12d3a7a3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:53.417887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:53.419418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:53.464997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:53.465657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:53.465978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:53.466259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:53.468494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:53.498114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1005/1973] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:53.512417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:53.514472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:53.539807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:53.541854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:53.561628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 969/1974] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:19:53.610047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059e66c-c243-44e0-b11f-cde54d57a9b4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:53.616013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:53.616735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:53.617020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:53.617296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:53.630178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:53.633493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:53.648806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1006/1975] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:54.354875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:54.357372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:54.366589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:54.385312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57abe7-1e51-4e01-96cc-abcd42272de7 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:54.397382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:54.409098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:54.409098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:54.409098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] PATH_INFO: `/v3/projects/0273144082f247649ff3f866a6bdb759` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:54.409098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0273144082f247649ff3f866a6bdb759)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:54.409098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:54.570014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0273144082f247649ff3f866a6bdb759', 'request_id': 'req-a84509e6-21cd-4ae0-8142-5b148099030b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:54.583360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0273144082f247649ff3f866a6bdb759', 'request_id': 'req-a84509e6-21cd-4ae0-8142-5b148099030b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:54.686887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0273144082f247649ff3f866a6bdb759', 'request_id': 'req-a84509e6-21cd-4ae0-8142-5b148099030b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:54.700549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] The token cache is being invalidate because project 0273144082f247649ff3f866a6bdb759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:54.700856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:54.701820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:54.703530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 970/1976] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:54 2022] DELETE /identity/v3/projects/0273144082f247649ff3f866a6bdb759 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:54.708029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:54.718894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8087ce-74c1-4c8f-9716-a11b92e8ce65 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:54.780265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:54.781028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:54.781308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:54.781584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] PATH_INFO: `/v3/users/8ef363062bbf4e6ba4aa4cccaa735e71` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:54.782829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ef363062bbf4e6ba4aa4cccaa735e71)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:54.784809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:55.003291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ef363062bbf4e6ba4aa4cccaa735e71'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.019338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ef363062bbf4e6ba4aa4cccaa735e71'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.103865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ef363062bbf4e6ba4aa4cccaa735e71'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.104490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ef363062bbf4e6ba4aa4cccaa735e71'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.112447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ef363062bbf4e6ba4aa4cccaa735e71'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.119657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1007/1977] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:54 2022] DELETE /identity/v3/users/8ef363062bbf4e6ba4aa4cccaa735e71 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:55.133220 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:55.613467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:55.633393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:55.645760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84509e6-21cd-4ae0-8142-5b148099030b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:55.773427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:55.774523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:55.774782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:55.776740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] PATH_INFO: `/v3/projects/6bd06b5624374eb1b60ef118d76e4d74` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:55.778094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd06b5624374eb1b60ef118d76e4d74)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:55.780121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:55.892414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd06b5624374eb1b60ef118d76e4d74', 'request_id': 'req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.902925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd06b5624374eb1b60ef118d76e4d74', 'request_id': 'req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.949138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd06b5624374eb1b60ef118d76e4d74', 'request_id': 'req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.960895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] The token cache is being invalidate because project 6bd06b5624374eb1b60ef118d76e4d74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:55.961182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.961877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-d769eb3e-e51c-484b-bcaf-a4e9cd8e3ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:55.963467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 971/1978] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:55 2022] DELETE /identity/v3/projects/6bd06b5624374eb1b60ef118d76e4d74 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:55.967518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:55.968978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:55.982545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e367-036a-4ef7-8c7c-87b0371b6812 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:56.035917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:56.042761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:56.043679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:56.043965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:56.044246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] PATH_INFO: `/v3/users/807dcb10de9a41bd9c5d04339764760f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:56.045454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=807dcb10de9a41bd9c5d04339764760f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:56.047478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:56.239624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '807dcb10de9a41bd9c5d04339764760f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:56.259325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '807dcb10de9a41bd9c5d04339764760f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:56.362098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '807dcb10de9a41bd9c5d04339764760f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:56.363643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '807dcb10de9a41bd9c5d04339764760f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:56.378143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '807dcb10de9a41bd9c5d04339764760f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:56.399853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1008/1979] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:19:55 2022] DELETE /identity/v3/users/807dcb10de9a41bd9c5d04339764760f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:56.534358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fa17-aa8d-41eb-a95a-5389d2460815 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:56.534658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fa17-aa8d-41eb-a95a-5389d2460815 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:56.534939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8fa17-aa8d-41eb-a95a-5389d2460815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:56.555937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2fe8fa17-aa8d-41eb-a95a-5389d2460815 None None] MFA Rules not processed for user `e63c56eb2f5944d88ea4521fad5294d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:56.557577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2fe8fa17-aa8d-41eb-a95a-5389d2460815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:56.642256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 972/1980] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:57.133333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:57.503902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:57.545893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:57.547553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:57.624632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ac4f6-5662-401a-9ac2-22aba861d46c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:57.630399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:57.631417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:57.631847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:57.632133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] PATH_INFO: `/v3/projects/b5fbca940ca044a89d5637f6b084553e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:57.633560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5fbca940ca044a89d5637f6b084553e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:57.635618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:57.772475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5fbca940ca044a89d5637f6b084553e', 'request_id': 'req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:57.779209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5fbca940ca044a89d5637f6b084553e', 'request_id': 'req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:57.785267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5fbca940ca044a89d5637f6b084553e', 'request_id': 'req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:57.905116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] The token cache is being invalidate because project b5fbca940ca044a89d5637f6b084553e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:19:57.905410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:57.906136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3cc7754-ef38-492d-a0be-a7c2fbce59f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:19:57.915909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1009/1981] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:19:57 2022] DELETE /identity/v3/projects/b5fbca940ca044a89d5637f6b084553e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:19:57.916513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:57.917312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:57.917762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:57.941120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:57.943553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:58.025773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 973/1982] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:19:58.030531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.031420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.031722 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.051260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:58.052651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:58.061231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1010/1983] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:58.065892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.075930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6af3e9a-75b4-4796-9879-987d7c8634ec None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.081386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.082470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.082707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.083042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.084480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:19:58.084794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.086451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.107785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 974/1984] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:19:58.116588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.130383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105df2a-3e55-4bf8-b74b-d82027341558 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.135164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.135930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.136114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.136391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.137134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.139473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.228818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1011/1985] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/projects => generated 409 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:58.232610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.243077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10675f8b-8497-46ce-af00-eab940576a02 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.292494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:58.303965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.304696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.304989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.305262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.305997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.307960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.430375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 975/1986] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/users => generated 305 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:58.434773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.448420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639c3d9-3929-46f0-9a73-c13f907ddcd6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.453162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.453967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.454708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.455055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.455895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.462292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.481605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1012/1987] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:58.482497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.494463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6bdaf-a8e7-4ceb-988f-19087dc24e24 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.500267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.501168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.501710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.502308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.511693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.511693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054d0d7-7e34-4e25-ab42-6a95b2c31720 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.517658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 976/1988] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:58.522358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.532972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0385120-db57-457d-a3c9-1da34406b749 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.537509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.538464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.538745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.539022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] PATH_INFO: `/v3/projects/30b2b6b834244012992e7dc336b14d95/users/2672fa51b0a048508eca1315ada57c50/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.555009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b2b6b834244012992e7dc336b14d95, user_id=2672fa51b0a048508eca1315ada57c50, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.557671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.686349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1013/1989] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:58 2022] PUT /identity/v3/projects/30b2b6b834244012992e7dc336b14d95/users/2672fa51b0a048508eca1315ada57c50/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:58.699117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.699424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.699696 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.738031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] MFA Rules not processed for user `2672fa51b0a048508eca1315ada57c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:58.739274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:58.810503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 977/1990] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:58.815013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:58.879735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704a7a2-cbef-4890-bcdb-2912e61b1169 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:58.885216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:58.885923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:58.886210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:58.886540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:58.887180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:58.889094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:58.992609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1014/1991] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/projects => generated 407 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:58.996645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.008715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f8f79a-0804-4ead-bcab-85fb9075ebca None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.075265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.076414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.076874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.077153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.077887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.080190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.095657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:59.184579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 978/1992] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:19:58 2022] POST /identity/v3/users => generated 310 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:19:59.185048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.204983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3465cf4-5939-4884-bcf0-49b1a500800f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.212722 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.214252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.217001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.217001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.217001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.219283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.233379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1015/1993] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:19:59.237916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.249488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8930d-94f9-4816-abfc-75782fb1e74d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.254583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.256128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.256606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.257084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] PATH_INFO: `/v3/projects/9fd02df5bbbe44928232e6813408b63e/users/7e7cd65d9cfd4dd180e908831297ee68/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.274597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd02df5bbbe44928232e6813408b63e, user_id=7e7cd65d9cfd4dd180e908831297ee68, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.277232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.331224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 979/1994] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:59 2022] PUT /identity/v3/projects/9fd02df5bbbe44928232e6813408b63e/users/7e7cd65d9cfd4dd180e908831297ee68/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:59.336284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.347060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5006a176-b8c7-4e8a-b163-6410d9eead48 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.361184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:19:59.407740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.408289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.408569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.408852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.409582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.411244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3b209-bc90-418b-8851-e71d56239ecb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.425019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1016/1995] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:19:59.426195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.437763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432032-9b7c-4740-9097-f516773ceb59 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.442625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.444144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.444427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.444702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] PATH_INFO: `/v3/projects/9fd02df5bbbe44928232e6813408b63e/users/7e7cd65d9cfd4dd180e908831297ee68/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.446723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fd02df5bbbe44928232e6813408b63e, user_id=7e7cd65d9cfd4dd180e908831297ee68, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.449392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.460354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 980/1996] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:19:59 2022] PUT /identity/v3/projects/9fd02df5bbbe44928232e6813408b63e/users/7e7cd65d9cfd4dd180e908831297ee68/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:19:59.470627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.470917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.471196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.501966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] MFA Rules not processed for user `7e7cd65d9cfd4dd180e908831297ee68`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:19:59.503880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:59.583048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1017/1997] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:19:59 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:19:59.594073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:19:59.595770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:19:59.667281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198c820-b7c1-46b0-b78a-d983d3a47903 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:19:59.670285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:19:59.671018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:19:59.671369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:19:59.671728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:19:59.682404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:19:59.683960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb33b0-df0f-44e5-aa97-b49d57898164 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:19:59.698582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 981/1998] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:19:59 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:19:59.732369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:00.073163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:00.084736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdd9431-fb32-4ee4-b78b-e45b4bad0fba None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:00.088552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:00.089270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:00.089618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:00.089994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:00.155723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:00.157168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6f10a3-af34-4c35-9382-3c06ac9b6f6b service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:00.169169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1018/1999] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:00 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:00.379405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:01.183376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:01.954936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:02.868075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:02.868453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:02.871204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:02.871204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 982/2000] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:20:02.887282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:02.887863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:02.887863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:02.908235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:02.909473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:03.015196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1019/2001] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:20:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:03.028647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:03.030751 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:03.049975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:03.050952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b59989-f1f3-4163-ad09-b45610150ba9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:03.051726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:03.056832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:03.057842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:03.058307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:03.058734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:03.069942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:03.075496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:03.102869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 983/2002] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:03.158882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef1932-01ec-44b5-8027-6130976f3a46 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:03.166084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:03.167056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:03.167428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:03.167859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] PATH_INFO: `/v3/users/d86ae885b5184169b0f7742acd58f08e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:03.169510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d86ae885b5184169b0f7742acd58f08e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:03.172037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:03.439118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd86ae885b5184169b0f7742acd58f08e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:03.450997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd86ae885b5184169b0f7742acd58f08e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:03.560856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd86ae885b5184169b0f7742acd58f08e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:03.562594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:03.563298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd86ae885b5184169b0f7742acd58f08e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:03.571590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79ec9f85-a528-4977-b46a-f0dc1511ff4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd86ae885b5184169b0f7742acd58f08e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:03.578923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1020/2003] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:03 2022] DELETE /identity/v3/users/d86ae885b5184169b0f7742acd58f08e => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:03.947621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:03.959212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a73eb-8105-4333-97c0-2b7dbe16a490 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.012907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:04.023699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.024629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.024900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.025175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] PATH_INFO: `/v3/projects/7fa4bf3881fe494db870e0f220a34824` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.026407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa4bf3881fe494db870e0f220a34824)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.028318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.177948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa4bf3881fe494db870e0f220a34824', 'request_id': 'req-3be206fc-2f4c-4525-b5da-5488d498e824'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:04.184223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa4bf3881fe494db870e0f220a34824', 'request_id': 'req-3be206fc-2f4c-4525-b5da-5488d498e824'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:04.297514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa4bf3881fe494db870e0f220a34824', 'request_id': 'req-3be206fc-2f4c-4525-b5da-5488d498e824'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:04.308734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] The token cache is being invalidate because project 7fa4bf3881fe494db870e0f220a34824 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:04.309025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:04.309665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3be206fc-2f4c-4525-b5da-5488d498e824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:04.311329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 984/2004] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:03 2022] DELETE /identity/v3/projects/7fa4bf3881fe494db870e0f220a34824 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:04.316468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.316958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.317070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.337043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:04.338343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:04.416373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1021/2005] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:04.426147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.426147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.426147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.449994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:04.451213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:04.460466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 985/2006] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:04.465371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.475640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a774a0-e403-4922-b370-75db8c84f048 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.480603 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.481255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.481707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.482010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.482747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:04.483097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.484686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.500758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1022/2007] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:20:04.502127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.510612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:04.514535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4744183d-7ca8-4151-a445-3346cb7659cc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.519324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.520002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.522453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.522453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.522453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.523867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.648184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 986/2008] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:04 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:04.652524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.662683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515c03f-2b66-4cf7-a3a8-b77580a3a58c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.727686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.728436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.728858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.729140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.729953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.731796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.823954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1023/2009] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:04 2022] POST /identity/v3/users => generated 302 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:04.828342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.838879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02831f1-a7e7-4fab-b688-9334d23ab237 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.843507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.844225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.844559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.844857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.845490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.847185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.858303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 987/2010] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:04.862543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.873433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e03467-02d9-46f4-a2f6-6bb7035fda91 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.878201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.878863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.879139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.879412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.880716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.882326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c92dd5-b798-44e0-b7f7-6d5cc3da9ae6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:04.894219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1024/2011] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:04.898700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:04.908741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a4e21-b803-4bc2-887e-84a0f9f98f45 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:04.913556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:04.914457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:04.914747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:04.915021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] PATH_INFO: `/v3/projects/e58e30d520b34e9bb34c32c691de8381/users/9c958ef5aff34839893407e1ac1d3f2f/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:04.931836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58e30d520b34e9bb34c32c691de8381, user_id=9c958ef5aff34839893407e1ac1d3f2f, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:04.934575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:05.129655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 988/2012] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:04 2022] PUT /identity/v3/projects/e58e30d520b34e9bb34c32c691de8381/users/9c958ef5aff34839893407e1ac1d3f2f/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:05.134835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53ce9-2d80-4742-b0fe-53715274064f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:05.142321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53ce9-2d80-4742-b0fe-53715274064f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:05.142321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53ce9-2d80-4742-b0fe-53715274064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:05.156359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-79a53ce9-2d80-4742-b0fe-53715274064f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:05.158688 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-79a53ce9-2d80-4742-b0fe-53715274064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:05.162018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:05.247119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1025/2013] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:05.253800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:05.256978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:05.319140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd883b6-24a4-48e8-aab8-a74de3c78604 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:05.323379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:05.323934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:05.324222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:05.324999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:05.337009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:05.339379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:05.351575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 989/2014] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:05.748712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:06.326346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:06.715338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:06.715625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:06.719961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:06.776443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] MFA Rules not processed for user `9c958ef5aff34839893407e1ac1d3f2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:06.778929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:06.882184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1026/2015] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:06.886785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:06.899351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1c32a8-fe94-442c-93f1-c95774ee78ca service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:06.904167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:06.904968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:06.905253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:06.905531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:06.906323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:06.908245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.002423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 990/2016] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:06 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:07.006640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:07.025775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777e959-7b7c-4105-915f-3a5cd1179686 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:07.086743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:07.087664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:07.088020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:07.088364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:07.090070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:07.094475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.182968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1027/2017] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:07 2022] POST /identity/v3/users => generated 309 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:07.185610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:07.195324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:07.199127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c5a8e7-0f13-4d38-9feb-702eb7271f21 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:07.203889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:07.204591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:07.204871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:07.205176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:07.205933 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:07.211833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.219593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 991/2018] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:07.224153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:07.234638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11a51f-fc47-4832-8b94-aba1f02a46ac admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:07.240378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:07.241261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:07.241797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:07.242466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] PATH_INFO: `/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6/users/c4f823dace3c4d3f92127185dd9cd0be/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:07.258210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccbb80c9b2a4aa48d6c5856860eeea6, user_id=c4f823dace3c4d3f92127185dd9cd0be, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:07.264620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.332156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1028/2019] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:07 2022] PUT /identity/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6/users/c4f823dace3c4d3f92127185dd9cd0be/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:07.336274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:07.346814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d24b-668f-4068-a16a-88aceb63e9ba admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:07.403200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:07.407857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:07.407857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:07.407857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:07.407857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:07.407857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.417765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 992/2020] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:07.422353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:07.435716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c402f8-7d6d-4cfc-929e-3d9b73fa635a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:07.442376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:07.443695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:07.444281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:07.444701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] PATH_INFO: `/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6/users/c4f823dace3c4d3f92127185dd9cd0be/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:07.447574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ccbb80c9b2a4aa48d6c5856860eeea6, user_id=c4f823dace3c4d3f92127185dd9cd0be, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:07.452422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf85a09-18a1-47e3-83e3-04ec425e2ffe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:07.465551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1029/2021] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:07 2022] PUT /identity/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6/users/c4f823dace3c4d3f92127185dd9cd0be/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:07.726737 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:08.138036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:08.674063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:08.675797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:08.687989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40149853-9d7d-4829-bb86-e74847328a41 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:08.746888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:08.747778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:08.748210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:08.748493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] PATH_INFO: `/v3/users/2672fa51b0a048508eca1315ada57c50` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:08.749707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2672fa51b0a048508eca1315ada57c50)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:08.751735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:08.786225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00afb4-5e3f-4091-9d57-eb074f4e9b65 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:08.787282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00afb4-5e3f-4091-9d57-eb074f4e9b65 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:08.787433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00afb4-5e3f-4091-9d57-eb074f4e9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:08.816436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ae00afb4-5e3f-4091-9d57-eb074f4e9b65 None None] MFA Rules not processed for user `c4f823dace3c4d3f92127185dd9cd0be`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:08.818410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ae00afb4-5e3f-4091-9d57-eb074f4e9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:08.903676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:08.932846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1030/2022] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:08 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:09.003822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2672fa51b0a048508eca1315ada57c50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:09.018393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2672fa51b0a048508eca1315ada57c50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:09.102947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2672fa51b0a048508eca1315ada57c50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:09.119547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2672fa51b0a048508eca1315ada57c50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:09.119547 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2672fa51b0a048508eca1315ada57c50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:09.123174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 993/2023] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:08 2022] DELETE /identity/v3/users/2672fa51b0a048508eca1315ada57c50 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:09.129137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:09.129692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:09.130187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:09.152087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:09.154078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:09.275755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1031/2024] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:09.307400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:09.311207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:09.384840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5348f7e-c82f-4bd6-a392-2f4ef548605a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:09.389550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:09.390263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:09.390570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:09.390842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:09.402397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:09.403897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:09.424761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 994/2025] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:10.017675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:10.060328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:10.061602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:10.074866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c08f6-07f8-4fe6-a0b1-c70f4c592a8f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:10.085079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:10.086053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:10.086339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:10.086641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] PATH_INFO: `/v3/projects/30b2b6b834244012992e7dc336b14d95` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:10.087972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b2b6b834244012992e7dc336b14d95)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:10.090575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:10.143182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:10.239114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b2b6b834244012992e7dc336b14d95', 'request_id': 'req-53f3f2db-7114-4d05-87c9-4d1537dfec3d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.246447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b2b6b834244012992e7dc336b14d95', 'request_id': 'req-53f3f2db-7114-4d05-87c9-4d1537dfec3d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.252180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b2b6b834244012992e7dc336b14d95', 'request_id': 'req-53f3f2db-7114-4d05-87c9-4d1537dfec3d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.337304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:10.338777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:10.365468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] The token cache is being invalidate because project 30b2b6b834244012992e7dc336b14d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:10.371607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.371607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.371607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1032/2026] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:10 2022] DELETE /identity/v3/projects/30b2b6b834244012992e7dc336b14d95 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:10.372936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:10.374874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:10.422507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a18ed-f152-41ed-b398-c816f52a791f service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:10.446096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3f2db-7114-4d05-87c9-4d1537dfec3d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:10.451082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:10.451959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:10.452236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:10.452506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] PATH_INFO: `/v3/users/7e7cd65d9cfd4dd180e908831297ee68` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:10.453742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7cd65d9cfd4dd180e908831297ee68)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:10.455695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:10.474263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:10.479864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:10.479864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:10.479864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:10.479864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:10.554172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:10.555642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:10.565833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 995/2027] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:20:10.566712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:10.568088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:10.581142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c7008-57d9-422c-ab3d-0309dd821067 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:10.586645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:10.588318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:10.588318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:10.588318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] PATH_INFO: `/v3/users/9c958ef5aff34839893407e1ac1d3f2f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:10.589569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c958ef5aff34839893407e1ac1d3f2f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:10.591557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:10.658538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7cd65d9cfd4dd180e908831297ee68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.671425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7cd65d9cfd4dd180e908831297ee68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.737016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7cd65d9cfd4dd180e908831297ee68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.737763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7cd65d9cfd4dd180e908831297ee68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.745573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7cd65d9cfd4dd180e908831297ee68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.751869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1033/2028] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:10 2022] DELETE /identity/v3/users/7e7cd65d9cfd4dd180e908831297ee68 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:10.775820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c958ef5aff34839893407e1ac1d3f2f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.788732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c958ef5aff34839893407e1ac1d3f2f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.874320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c958ef5aff34839893407e1ac1d3f2f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.882450 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c958ef5aff34839893407e1ac1d3f2f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.883136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c958ef5aff34839893407e1ac1d3f2f'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:10.889523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 996/2029] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:10 2022] DELETE /identity/v3/users/9c958ef5aff34839893407e1ac1d3f2f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:11.196442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:11.198038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:11.242613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:11.244165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:11.329972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a293d7-4952-44ba-9f0a-86141f22cd09 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:11.348856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2735c1-c28f-4f19-b641-a6d5f9c14c65 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:11.362836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:11.370506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.375042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.375042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] PATH_INFO: `/v3/projects/9fd02df5bbbe44928232e6813408b63e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.375042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fd02df5bbbe44928232e6813408b63e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:11.375042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:11.403123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:11.404147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.404429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.404708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] PATH_INFO: `/v3/projects/e58e30d520b34e9bb34c32c691de8381` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.409430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:11.409625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58e30d520b34e9bb34c32c691de8381)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:11.409625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:11.495673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fd02df5bbbe44928232e6813408b63e', 'request_id': 'req-a2be9028-0900-424e-8752-c9fa36614429'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.503587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fd02df5bbbe44928232e6813408b63e', 'request_id': 'req-a2be9028-0900-424e-8752-c9fa36614429'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.555968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58e30d520b34e9bb34c32c691de8381', 'request_id': 'req-7261da23-209f-4b55-8615-6b03c7fab2a7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.562573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58e30d520b34e9bb34c32c691de8381', 'request_id': 'req-7261da23-209f-4b55-8615-6b03c7fab2a7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.568727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58e30d520b34e9bb34c32c691de8381', 'request_id': 'req-7261da23-209f-4b55-8615-6b03c7fab2a7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.576585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fd02df5bbbe44928232e6813408b63e', 'request_id': 'req-a2be9028-0900-424e-8752-c9fa36614429'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.589625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] The token cache is being invalidate because project 9fd02df5bbbe44928232e6813408b63e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:11.590004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.590691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a2be9028-0900-424e-8752-c9fa36614429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.592247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 997/2030] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:11 2022] DELETE /identity/v3/projects/9fd02df5bbbe44928232e6813408b63e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:11.597122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2802-20a1-4f7f-be08-53ee42069ac0 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.597475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2802-20a1-4f7f-be08-53ee42069ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.597849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9e2802-20a1-4f7f-be08-53ee42069ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.617395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5c9e2802-20a1-4f7f-be08-53ee42069ac0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:11.618626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5c9e2802-20a1-4f7f-be08-53ee42069ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:11.687219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] The token cache is being invalidate because project e58e30d520b34e9bb34c32c691de8381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:11.687793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.688550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:11.693517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1034/2031] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:11 2022] DELETE /identity/v3/projects/e58e30d520b34e9bb34c32c691de8381 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:11.694555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:11.695945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 998/2032] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:11.704157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:11.705757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.706104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.706383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.712686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261da23-209f-4b55-8615-6b03c7fab2a7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:11.722494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:11.724500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.726216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.726724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] PATH_INFO: `/v3/users/c4f823dace3c4d3f92127185dd9cd0be` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.729993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f823dace3c4d3f92127185dd9cd0be)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:11.733148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:11.745350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:11.746985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:11.763095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 999/2033] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:11.768182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:11.785421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4176762-3201-403d-92f0-d0b9cd57e8d6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:11.801500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:11.802333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.802687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.803032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.803908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:11.804407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:11.806144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:11.820525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1000/2034] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:20:11.824987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:11.836105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974acd7-64c6-4f6a-b133-e2b1fd3f64d2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:11.840865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:11.841525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:11.841867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:11.842148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:11.842839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:11.844758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:11.939244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1001/2035] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:11 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:11.943425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.007136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98344bf6-72b9-449d-959b-50ba33bffa51 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.013275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.013945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.014237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.014517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.015417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.017351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.026738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f823dace3c4d3f92127185dd9cd0be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.039621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f823dace3c4d3f92127185dd9cd0be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.091531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1002/2036] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:11 2022] POST /identity/v3/users => generated 291 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:12.096175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.102598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f823dace3c4d3f92127185dd9cd0be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.103344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f823dace3c4d3f92127185dd9cd0be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.106594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0640b71-bf86-43e3-9907-bf3de6f0f38f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.110920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f823dace3c4d3f92127185dd9cd0be'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.111187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.111847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.112128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.112425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.113178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.115408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.118357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1035/2037] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:11 2022] DELETE /identity/v3/users/c4f823dace3c4d3f92127185dd9cd0be => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:12.129369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1003/2038] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:12.133261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.134770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.202058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e654e-0fcc-498d-8c58-d69da13fb58d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.207185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.207862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.208639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.208923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.209671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.211371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed6066-20e6-43b1-b505-e7a04f9cd616 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.222296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1036/2039] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:12.226995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.237083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371180ff-e912-43c0-8d35-c28322b6045f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.242014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.242901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.243188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.243467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] PATH_INFO: `/v3/projects/a167ced486e145eca49d2f275b5daa70/users/4fe5b59d27d54d93a5c58b2bce7fb6b3/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.246255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:12.258960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a167ced486e145eca49d2f275b5daa70, user_id=4fe5b59d27d54d93a5c58b2bce7fb6b3, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.261788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.366125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1004/2040] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:12 2022] PUT /identity/v3/projects/a167ced486e145eca49d2f275b5daa70/users/4fe5b59d27d54d93a5c58b2bce7fb6b3/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:12.377690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.378031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.378313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.383501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.385506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.409471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] MFA Rules not processed for user `4fe5b59d27d54d93a5c58b2bce7fb6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:12.410942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.469388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4859f-c71e-48e7-bfbf-df24dae1a3a5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.475081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.475954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.476237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.476534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] PATH_INFO: `/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.477704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ccbb80c9b2a4aa48d6c5856860eeea6)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.479707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.491904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1037/2041] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:12.496613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.508940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735da989-0178-438d-899b-c241f7a59aa8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.514842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.515794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.516081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.516357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.517064 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.519557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.591645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ccbb80c9b2a4aa48d6c5856860eeea6', 'request_id': 'req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.598618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ccbb80c9b2a4aa48d6c5856860eeea6', 'request_id': 'req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.624347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1038/2042] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:12.624347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.679647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ccbb80c9b2a4aa48d6c5856860eeea6', 'request_id': 'req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.692087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] The token cache is being invalidate because project 3ccbb80c9b2a4aa48d6c5856860eeea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:12.692910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.694141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1a7813b9-9c00-46b6-b33b-e4f1f3103b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:12.696163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1005/2043] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:12 2022] DELETE /identity/v3/projects/3ccbb80c9b2a4aa48d6c5856860eeea6 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:12.699474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4cf80-ffd9-4416-b9a6-b73c7c8e5415 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.703451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7216c-b135-42b5-b045-a897687418b2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.703904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7216c-b135-42b5-b045-a897687418b2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.704388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7216c-b135-42b5-b045-a897687418b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.704691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.705938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.706726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.707127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.707841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.710536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.732198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-63b7216c-b135-42b5-b045-a897687418b2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:12.733462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-63b7216c-b135-42b5-b045-a897687418b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.744321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1006/2044] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:12.754520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.754802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.755605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.777181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:12.778426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.786381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1007/2045] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:12.790643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.799561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a892c9-4274-4d3e-b845-7779a5a762c5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.804152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.804782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.805063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.805338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.806094 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:12.806400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.807980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.819127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1039/2046] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/users => generated 297 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:12.823554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1008/2047] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:20:12.823896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.824581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.825593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:12.835701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f0b14-edfe-4730-b28a-452de7b7907a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.838915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ecd0a-865a-47ed-b0e7-99e789808e12 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.841434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.844114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.844114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.844114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.844114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.845530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.845625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.846371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.846718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.847073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.847885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.849768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.861767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1040/2048] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:12.865853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:12.876082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d6a49-c89f-47b3-afef-ecdb8c9f19f3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:12.881157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:12.882131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:12.882415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:12.882692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] PATH_INFO: `/v3/projects/960402812c1d4589b70a1a0196531729/users/53ad41643ee74d74941e9803245daa28/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:12.898586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960402812c1d4589b70a1a0196531729, user_id=53ad41643ee74d74941e9803245daa28, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:12.901174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:12.982803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1009/2049] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/projects => generated 367 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:12.983865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.001759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1041/2050] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:12 2022] PUT /identity/v3/projects/960402812c1d4589b70a1a0196531729/users/53ad41643ee74d74941e9803245daa28/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:13.005496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.057350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d790e3-2c35-46d7-b8fa-c44782752f83 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.068068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d39ec-c5a5-44d5-b4f1-049c79d6da75 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.073201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.073924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.074296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.074755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.075587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.077265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.093783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1042/2051] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:13.098184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.109535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c6d03-77c5-405d-9648-bc8683501a2f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.115671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.116610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.116884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.117158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] PATH_INFO: `/v3/projects/960402812c1d4589b70a1a0196531729/users/53ad41643ee74d74941e9803245daa28/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.119899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960402812c1d4589b70a1a0196531729, user_id=53ad41643ee74d74941e9803245daa28, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.123002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c874376-c861-410b-936d-1a2326b05909 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.126718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.127333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.127612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.127886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.128594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.130756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.134905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:13.135152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1043/2052] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:13 2022] PUT /identity/v3/projects/960402812c1d4589b70a1a0196531729/users/53ad41643ee74d74941e9803245daa28/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:13.144990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.145274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.146128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.175179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] MFA Rules not processed for user `53ad41643ee74d74941e9803245daa28`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:13.176403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:13.237033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1010/2053] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:12 2022] POST /identity/v3/users => generated 284 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:13.239048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.250226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b1e17-08c0-4d43-b9ca-18e73ea6e9f3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.258481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:13.264005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1044/2054] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:13.278063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.279487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:13.317023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.318260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.318539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.318811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.319544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.321179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.337128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1011/2055] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:13.341104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.341216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698adb78-fd20-4c76-a08b-1f632e50a880 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.344490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.345133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.345406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.345684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.348318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7b7a4-e120-4b10-9f7d-0ff6fe5ce879 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.353970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.354664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.354943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.355219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.355472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.355942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.356942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.357520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895d8d5-e0d5-4354-8605-3ec3c6f7e52a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.367403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1045/2056] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:13 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:20:13.369093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1012/2057] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:13.373317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.387283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d271047-806b-4a31-9baf-2876ceb0e4fe service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.392853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.393816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.394093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.394364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] PATH_INFO: `/v3/projects/793c5027559f459ca63078a899a144a2/users/0131f24cbde648929be4267e4f34db96/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.411851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=793c5027559f459ca63078a899a144a2, user_id=0131f24cbde648929be4267e4f34db96, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.414709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.468296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1046/2058] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:13 2022] PUT /identity/v3/projects/793c5027559f459ca63078a899a144a2/users/0131f24cbde648929be4267e4f34db96/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:13.480183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.480548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.480894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.508378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] MFA Rules not processed for user `0131f24cbde648929be4267e4f34db96`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:13.509629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:13.580562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1013/2059] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:13.588725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.657138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2762af88-a883-49f7-8158-499d20bd7e58 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.663082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.663742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.664020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.664299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.665076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.667070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.697315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:13.758522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1047/2060] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:13 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:13.759699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.771298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da4df-14db-4d46-b2e4-e40513cc6c2c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.788920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:13.831888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.832571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.832853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.833640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.834369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.836300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.918533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.928827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719aedd-d731-47a2-90fd-136ceb2f88bd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.933615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.934501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.934771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.935047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] PATH_INFO: `/v3/users/4fe5b59d27d54d93a5c58b2bce7fb6b3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.936219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe5b59d27d54d93a5c58b2bce7fb6b3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.938168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.961192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1014/2061] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:13 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:13.965131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:13.975777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73794f-48b3-4128-a8a5-7d9df925bef3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:13.980332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:13.981051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:13.981373 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:13.981670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:13.982420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:13.984018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:13.993884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1015/2062] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:13.997758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:14.007288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade14f2-f060-45bc-9f9b-aa0f5d6107f3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:14.012218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:14.013074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.013353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.013630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] PATH_INFO: `/v3/projects/0ccedde18f1641f29e1acae382f87bdd/users/dba15ad2f2b44295b1629a408befb2b1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.031625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccedde18f1641f29e1acae382f87bdd, user_id=dba15ad2f2b44295b1629a408befb2b1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:14.034391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:14.178816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1016/2063] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:13 2022] PUT /identity/v3/projects/0ccedde18f1641f29e1acae382f87bdd/users/dba15ad2f2b44295b1629a408befb2b1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:14.182523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.183691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:14.188885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe5b59d27d54d93a5c58b2bce7fb6b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:14.200840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe5b59d27d54d93a5c58b2bce7fb6b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:14.239594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.245464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e53008-08e7-466a-af25-051cf6fd68bb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:14.250247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:14.250914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.251194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.251472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.252199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:14.253834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:14.264258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1017/2064] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:20:14.268024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe5b59d27d54d93a5c58b2bce7fb6b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:14.268633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:14.268785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe5b59d27d54d93a5c58b2bce7fb6b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:14.270353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:14.281642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8301edbb-ed16-4d1f-89e2-cb3085f46bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe5b59d27d54d93a5c58b2bce7fb6b3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:14.284102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1048/2065] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:13 2022] DELETE /identity/v3/users/4fe5b59d27d54d93a5c58b2bce7fb6b3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:14.287177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad0090-19ac-4853-ab86-df5f1903af45 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:14.288724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.289014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.289408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.308451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:14.309906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:14.346452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:14.346703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.346801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.347072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] PATH_INFO: `/v3/projects/0ccedde18f1641f29e1acae382f87bdd/users/dba15ad2f2b44295b1629a408befb2b1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.349123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccedde18f1641f29e1acae382f87bdd, user_id=dba15ad2f2b44295b1629a408befb2b1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:14.351821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746dff33-86f6-40d0-9c75-ff0a643e7a44 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:14.363255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1018/2066] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:14 2022] PUT /identity/v3/projects/0ccedde18f1641f29e1acae382f87bdd/users/dba15ad2f2b44295b1629a408befb2b1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:14.374928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.375517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.376214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1049/2067] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:14.378912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.388561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:14.390248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:14.411995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] MFA Rules not processed for user `dba15ad2f2b44295b1629a408befb2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:14.413137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:14.429229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.454710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff4bd6-d7db-4969-bf75-db8eb2aae661 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:14.465464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.491937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1019/2068] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:14.503543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:14.504996 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:14.507487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:14.508166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.508447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.508726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.528222 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.543904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.565681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b22609-309e-4953-8bd6-0c7918cd6e88 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:14.570044 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:14.570693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:14.570972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:14.571247 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:14.577567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:14.577567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:14.580572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:14.582318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:14.583803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1050/2069] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:20:14.593914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1020/2070] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:14.628651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:14.743080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:15.001171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:15.002611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:15.019731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aab6e1-f410-48ce-92cf-1e8e54a67a20 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:15.022646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:15.023598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:15.023954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:15.024303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] PATH_INFO: `/v3/projects/a167ced486e145eca49d2f275b5daa70` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:15.025780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a167ced486e145eca49d2f275b5daa70)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:15.027809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:15.151827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a167ced486e145eca49d2f275b5daa70', 'request_id': 'req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.161453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a167ced486e145eca49d2f275b5daa70', 'request_id': 'req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.168788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a167ced486e145eca49d2f275b5daa70', 'request_id': 'req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.264636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:15.269024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] The token cache is being invalidate because project a167ced486e145eca49d2f275b5daa70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:15.269804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.270934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.272655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1051/2071] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:15 2022] DELETE /identity/v3/projects/a167ced486e145eca49d2f275b5daa70 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:15.277051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:15.290323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4285f9-abec-4716-a9b6-83e75d614765 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:15.355682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:15.356562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:15.356840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:15.357115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] PATH_INFO: `/v3/users/53ad41643ee74d74941e9803245daa28` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:15.358553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ad41643ee74d74941e9803245daa28)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:15.360806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:15.546793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ad41643ee74d74941e9803245daa28'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.572023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ad41643ee74d74941e9803245daa28'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.674170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ad41643ee74d74941e9803245daa28'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.686505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ad41643ee74d74941e9803245daa28'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.687410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-faeab407-09cf-419f-ba10-0a02fde09f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ad41643ee74d74941e9803245daa28'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:15.695525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1021/2072] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:15 2022] DELETE /identity/v3/users/53ad41643ee74d74941e9803245daa28 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:16.247084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:16.248793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:16.273445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9767bcc-f48c-4c89-b1a1-f3dfba1d744e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:16.341942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:16.342812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:16.343175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:16.346411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] PATH_INFO: `/v3/projects/960402812c1d4589b70a1a0196531729` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:16.348547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=960402812c1d4589b70a1a0196531729)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:16.350450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:16.472215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960402812c1d4589b70a1a0196531729', 'request_id': 'req-027a4d75-0fd7-486a-9f4c-544a3665f49d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:16.478717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960402812c1d4589b70a1a0196531729', 'request_id': 'req-027a4d75-0fd7-486a-9f4c-544a3665f49d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:16.484484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960402812c1d4589b70a1a0196531729', 'request_id': 'req-027a4d75-0fd7-486a-9f4c-544a3665f49d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:16.548068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] The token cache is being invalidate because project 960402812c1d4589b70a1a0196531729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:16.549076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:16.549989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-027a4d75-0fd7-486a-9f4c-544a3665f49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:16.551949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1052/2073] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:16 2022] DELETE /identity/v3/projects/960402812c1d4589b70a1a0196531729 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:16.559382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:16.559863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:16.559967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:16.585149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:16.586431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:16.663800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:16.681024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1022/2074] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:16.691552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:16.692929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:16.693316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:16.721903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:16.721903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:16.731083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1053/2075] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:16.742993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:16.757112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510650eb-cdc3-4a0a-9fad-a22a38495497 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:16.762958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:16.763950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:16.764326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:16.764695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:16.765542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:16.766635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:16.767626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:16.784354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1023/2076] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:20:16.795579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:16.814100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fde390-12a4-4a09-a63e-6691722d4871 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:16.826687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:16.827703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:16.829173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:16.829599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:16.830468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:16.839469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:16.986505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1054/2077] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:16 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:16.991221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.001890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17984e-b675-4a13-a6e1-58e9c24d64c9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.070299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.071362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.071790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.072389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.073236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.075483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:17.183857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1024/2078] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:16 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:17.188130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.198645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858458-4fce-4d1e-b931-4a655b87f017 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.203662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.204408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.204754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.205098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.206046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.207986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:17.219194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1055/2079] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:17.223968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.234525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785bc9-9202-46f0-84bf-2c8c018869f7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.239844 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.240525 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.240775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.241134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.242014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.246709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab794aa-d4a7-4e86-933e-785fb3f69dd8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:17.254260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1025/2080] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:17.258939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.272019 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a80704-3262-4531-9c72-4a8fb5974912 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.280208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.280208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.280208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.280208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] PATH_INFO: `/v3/projects/19f4e394a2c64e959994685eec5d020e/users/0df1bfa96fd84173a6e75d34f6c57dad/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.298547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f4e394a2c64e959994685eec5d020e, user_id=0df1bfa96fd84173a6e75d34f6c57dad, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.308903 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:17.400055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1056/2081] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:17 2022] PUT /identity/v3/projects/19f4e394a2c64e959994685eec5d020e/users/0df1bfa96fd84173a6e75d34f6c57dad/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:17.410509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.410791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.411593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.439618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] MFA Rules not processed for user `0df1bfa96fd84173a6e75d34f6c57dad`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:17.445117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:17.519810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1026/2082] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:17.534442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.537006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:17.576658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:17.615073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0463cc7-7aa2-44f4-b7b9-57f3e3819f7a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.618780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.619434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.619788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.620067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.635283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.636743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1136e-9df5-4a78-9e13-58cdd4ac9ad7 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:17.648115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1057/2083] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:17.808732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:17.810223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:17.887023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:17.890947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530df5f-6837-40a2-804d-94ba4713458b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:17.897096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:17.898013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:17.898294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:17.902845 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] PATH_INFO: `/v3/users/0131f24cbde648929be4267e4f34db96` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:17.904499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0131f24cbde648929be4267e4f34db96)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:17.906630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:18.133822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0131f24cbde648929be4267e4f34db96'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:18.145964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0131f24cbde648929be4267e4f34db96'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:18.217009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0131f24cbde648929be4267e4f34db96'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:18.227457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0131f24cbde648929be4267e4f34db96'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:18.237826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0131f24cbde648929be4267e4f34db96'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:18.237826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1027/2084] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:17 2022] DELETE /identity/v3/users/0131f24cbde648929be4267e4f34db96 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:18.241108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:18.241386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:18.241749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:18.259949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:18.261340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:18.333406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1058/2085] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:18.344567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:18.346805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:18.410839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f8fc-29bd-4d70-a3e4-4221da735db9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:18.414770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:18.415470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:18.415727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:18.416006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:18.427640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:18.429105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:18.440224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1028/2086] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:18.941354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:18.944956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:18.960890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed6f3e-c2c8-4559-b1ed-644412613939 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:18.966801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:18.969520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:18.969520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:18.969520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] PATH_INFO: `/v3/projects/793c5027559f459ca63078a899a144a2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:18.970166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=793c5027559f459ca63078a899a144a2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:18.971680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:19.149075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '793c5027559f459ca63078a899a144a2', 'request_id': 'req-045820ce-5a04-42c6-a697-f0aba7cf6137'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:19.156350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '793c5027559f459ca63078a899a144a2', 'request_id': 'req-045820ce-5a04-42c6-a697-f0aba7cf6137'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:19.163954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '793c5027559f459ca63078a899a144a2', 'request_id': 'req-045820ce-5a04-42c6-a697-f0aba7cf6137'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:19.254538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] The token cache is being invalidate because project 793c5027559f459ca63078a899a144a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:19.254914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:19.257162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:19.262630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1059/2087] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:18 2022] DELETE /identity/v3/projects/793c5027559f459ca63078a899a144a2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:19.266709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:19.280851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54bfcaf-f2d2-4156-b8ba-f48b3360212b service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:19.365527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:19.366532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:19.366884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:19.367231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] PATH_INFO: `/v3/users/dba15ad2f2b44295b1629a408befb2b1` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:19.368559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] RBAC: Authorizing `identity:delete_user(user_id=dba15ad2f2b44295b1629a408befb2b1)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:19.370530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:19.392534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:20.271058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dba15ad2f2b44295b1629a408befb2b1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:20.290698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dba15ad2f2b44295b1629a408befb2b1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:20.467787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dba15ad2f2b44295b1629a408befb2b1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:20.483253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dba15ad2f2b44295b1629a408befb2b1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:20.484115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-172f97aa-abdc-4984-be11-76e558ef24be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dba15ad2f2b44295b1629a408befb2b1'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:20.490366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1029/2088] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:19 2022] DELETE /identity/v3/users/dba15ad2f2b44295b1629a408befb2b1 => generated 0 bytes in 1224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:20.950344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:20.951797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:20.965675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045820ce-5a04-42c6-a697-f0aba7cf6137 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.017433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:21.026576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.027445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.027722 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.028030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] PATH_INFO: `/v3/projects/0ccedde18f1641f29e1acae382f87bdd` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.029255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ccedde18f1641f29e1acae382f87bdd)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.031207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.148333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ccedde18f1641f29e1acae382f87bdd', 'request_id': 'req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:21.154619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ccedde18f1641f29e1acae382f87bdd', 'request_id': 'req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:21.160138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ccedde18f1641f29e1acae382f87bdd', 'request_id': 'req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:21.259630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] The token cache is being invalidate because project 0ccedde18f1641f29e1acae382f87bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:21.259630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:21.259630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399d546a-c629-4e3e-8dc8-0e3436d3e9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:21.259630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1060/2089] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:20 2022] DELETE /identity/v3/projects/0ccedde18f1641f29e1acae382f87bdd => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:21.264659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d986477-0112-4451-8736-ad2953934b13 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.264942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d986477-0112-4451-8736-ad2953934b13 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.265236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d986477-0112-4451-8736-ad2953934b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.287932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6d986477-0112-4451-8736-ad2953934b13 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:21.290459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6d986477-0112-4451-8736-ad2953934b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:21.358799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1030/2090] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:21.366479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.366747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.367025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.386468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:21.387707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:21.396734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1061/2091] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:21.400998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d986477-0112-4451-8736-ad2953934b13 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.411609 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d986477-0112-4451-8736-ad2953934b13 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.416233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.416879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.417156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.417427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.418210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:21.418543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.420133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.431874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1031/2092] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:20:21.436358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.445791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714cb03-1bb8-43e0-9136-50bf071ffea7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.450493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.451144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.451426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.451703 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.452384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.454335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.550850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1062/2093] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:21 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:21.557985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.571477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865422-7e59-4d14-b149-cb08d668eeb2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.634753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.635567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.635763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.636023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.636708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.638965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.758676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1032/2094] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:21 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:21.762833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.774569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88365d-ab6e-4093-a59b-fa0a132e6f50 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.779169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.779834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.780115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.780385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.781156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.782780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.793651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1063/2095] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:21.800286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.811483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77055be-7a50-48de-a970-3c5d1491a779 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.817795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.818739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.819227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.819686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.820500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.822148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee2b57-4dcf-4204-81dd-7024ced77269 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.836403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1033/2096] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:21.840929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:21.863002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe4f09-34f0-4092-9097-ff7d4fdf46f2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:21.863002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:21.863002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.863002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.863624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] PATH_INFO: `/v3/projects/c48bbaa2b70948468a1f5a44ada022c1/users/f60f7a6d1bdc49a7844785023aceedae/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:21.894457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48bbaa2b70948468a1f5a44ada022c1, user_id=f60f7a6d1bdc49a7844785023aceedae, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:21.894457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:21.993361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1064/2097] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:21 2022] PUT /identity/v3/projects/c48bbaa2b70948468a1f5a44ada022c1/users/f60f7a6d1bdc49a7844785023aceedae/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:21.994906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:21.995269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:21.995622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.001832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:22.025442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] MFA Rules not processed for user `f60f7a6d1bdc49a7844785023aceedae`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:22.027032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:22.104831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1034/2098] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:22.109455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.183141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1b96-b1eb-4847-8fa8-15d05b560171 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.188350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.189066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.189376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.189712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.190475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.193300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.322063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1065/2099] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:22 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:22.326289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.339106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb1302c-d97f-4578-a49d-12d7c1b7d930 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.402271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.402961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.403250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.403535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.404491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.406504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.522584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1035/2100] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:22 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:20:22.523990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.530970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:22.534762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec045182-524c-47e4-9600-e72f44baf177 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.539933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.540597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.540877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.541149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.541910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.543502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.555418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1066/2101] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:22.559792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.571550 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cad153-d962-4951-b8c1-5715ea18c08d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.578532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.579517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.579870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.580216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] PATH_INFO: `/v3/projects/1e892693ac6b45e2acee197e7806d783/users/e6c171efabd34996a74358506259b4a8/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.597017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e892693ac6b45e2acee197e7806d783, user_id=e6c171efabd34996a74358506259b4a8, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.600809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.702312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1036/2102] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:22 2022] PUT /identity/v3/projects/1e892693ac6b45e2acee197e7806d783/users/e6c171efabd34996a74358506259b4a8/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:22.708246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.719932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196b684-e29a-4f12-ba32-86b9079eaf51 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.789797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.790467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.790748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.791022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.791743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.793331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40995b9-7b41-4301-b2bb-8c5159f9cc09 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.803375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1067/2103] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:22.807798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.819620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67384b2-9218-41e8-b495-7508c9950f03 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:22.824466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:22.825346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.825623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.825921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] PATH_INFO: `/v3/projects/1e892693ac6b45e2acee197e7806d783/users/e6c171efabd34996a74358506259b4a8/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.827974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e892693ac6b45e2acee197e7806d783, user_id=e6c171efabd34996a74358506259b4a8, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:22.830644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:22.841994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1037/2104] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:22 2022] PUT /identity/v3/projects/1e892693ac6b45e2acee197e7806d783/users/e6c171efabd34996a74358506259b4a8/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:22.852985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:22.853275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:22.853574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:22.881311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] MFA Rules not processed for user `e6c171efabd34996a74358506259b4a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:22.882317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:22.951636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1068/2105] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:22.964125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:22.965834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:23.016282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:23.028236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2fa04b-d4b8-46b3-9445-a82b1d0379db admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:23.032049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:23.032690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:23.032978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:23.033254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:23.043388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:23.044857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:23.056889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1038/2106] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:23.287511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:23.297738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfae19b-a73d-4011-8ad4-ea588564cff3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:23.301514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:23.302202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:23.302518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:23.302933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:23.368833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:23.370359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e89015-f3ad-40cf-9ea7-12a3b3d78cad service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:23.381059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1069/2107] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:31.100233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:31.164653 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69598e92-1e7c-45c1-87b7-8268bbc4793b service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:31.169196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:31.170089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:31.170400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:31.170645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] PATH_INFO: `/v3/users/f60f7a6d1bdc49a7844785023aceedae` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:31.171834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60f7a6d1bdc49a7844785023aceedae)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:31.174006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:31.387290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60f7a6d1bdc49a7844785023aceedae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:31.400967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60f7a6d1bdc49a7844785023aceedae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:31.501636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60f7a6d1bdc49a7844785023aceedae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:31.510267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60f7a6d1bdc49a7844785023aceedae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:31.511048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60f7a6d1bdc49a7844785023aceedae'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:31.517711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1039/2108] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:31 2022] DELETE /identity/v3/users/f60f7a6d1bdc49a7844785023aceedae => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:31.522575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:31.523047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:31.523241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:31.542101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:31.543327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:31.556864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:31.620743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1070/2109] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:31.630676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:31.632106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:31.695730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374b427-3c62-41f2-a3d5-7fb9ba1104bd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:31.699799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:31.700465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:31.700753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:31.701030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:31.711838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:31.713283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:31.723172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1040/2110] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:20:32.126053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:32.127479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:32.158587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692a9ff-a9b8-43ab-93fd-360826f3acb6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:32.166219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:32.167090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:32.167372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:32.167650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] PATH_INFO: `/v3/projects/c48bbaa2b70948468a1f5a44ada022c1` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:32.168887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48bbaa2b70948468a1f5a44ada022c1)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:32.170844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:32.286503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48bbaa2b70948468a1f5a44ada022c1', 'request_id': 'req-44b8b009-cd54-4ea4-ace1-545f18c8c303'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.294000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48bbaa2b70948468a1f5a44ada022c1', 'request_id': 'req-44b8b009-cd54-4ea4-ace1-545f18c8c303'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.300276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48bbaa2b70948468a1f5a44ada022c1', 'request_id': 'req-44b8b009-cd54-4ea4-ace1-545f18c8c303'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.398766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] The token cache is being invalidate because project c48bbaa2b70948468a1f5a44ada022c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:32.398766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.398766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.399363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1071/2111] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:32 2022] DELETE /identity/v3/projects/c48bbaa2b70948468a1f5a44ada022c1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:32.403683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:32.414021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626cda4-141d-4c33-b09e-6555bf1f86fb service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:32.418752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:32.476409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:32.477428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:32.477734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:32.478024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] PATH_INFO: `/v3/users/e6c171efabd34996a74358506259b4a8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:32.479269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c171efabd34996a74358506259b4a8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:32.481339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:32.688295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c171efabd34996a74358506259b4a8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.701638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c171efabd34996a74358506259b4a8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.798831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c171efabd34996a74358506259b4a8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.807279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c171efabd34996a74358506259b4a8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.808143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-24195f8b-a6bd-4152-8427-1f7c1fd72336 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c171efabd34996a74358506259b4a8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:32.814484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1041/2112] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:32 2022] DELETE /identity/v3/users/e6c171efabd34996a74358506259b4a8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:33.263050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:33.264479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:33.282107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b8b009-cd54-4ea4-ace1-545f18c8c303 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:33.345307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:33.346234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:33.346503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:33.346780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] PATH_INFO: `/v3/projects/1e892693ac6b45e2acee197e7806d783` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:33.347978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e892693ac6b45e2acee197e7806d783)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:33.350542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:33.461972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:33.469577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e892693ac6b45e2acee197e7806d783', 'request_id': 'req-2e43527b-80dc-4eb4-be51-58b63e53db7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:33.475248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e892693ac6b45e2acee197e7806d783', 'request_id': 'req-2e43527b-80dc-4eb4-be51-58b63e53db7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:33.481994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e892693ac6b45e2acee197e7806d783', 'request_id': 'req-2e43527b-80dc-4eb4-be51-58b63e53db7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:33.621024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] The token cache is being invalidate because project 1e892693ac6b45e2acee197e7806d783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:33.621312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:33.621956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-2e43527b-80dc-4eb4-be51-58b63e53db7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:33.623536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1072/2113] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:33 2022] DELETE /identity/v3/projects/1e892693ac6b45e2acee197e7806d783 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:33.628501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:33.629011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:33.629109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:33.648058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:33.649289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:33.714436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1042/2114] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:33.723564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:33.723863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:33.724139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:33.750428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:33.750428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:33.753662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1073/2115] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:33.758512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:33.768399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48193d-6603-499f-a8cb-9d5c2b7cc8df None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:33.773585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:33.774291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:33.774575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:33.774847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:33.775567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:33.775872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:33.777500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:33.789493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1043/2116] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:20:33.793635 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:33.803036 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644892b4-85ce-4089-a7ea-ac7c6f045b67 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:33.807787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:33.810517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:33.811166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:33.811448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:33.812201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:33.814194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:33.920591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1074/2117] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:33 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:33.921834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:33.934141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe10d1-678d-4dcc-ad5a-869b2a167bc3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:33.952613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:34.015669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:34.016352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:34.016630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:34.016899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:34.017821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:34.019802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:34.176479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1044/2118] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:33 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:34.180532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:34.193277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee38b2-cc2a-4655-8aa2-2a13390a2469 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:34.198033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:34.198728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:34.199486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:34.199486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:34.200066 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:34.201648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:34.213612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1075/2119] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:34.217864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:34.229055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773c726-0b21-4572-a24f-9f01c67ca093 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:34.235139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:34.235801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:34.236077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:34.236348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:34.237108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:34.238741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf94466-5d3e-4180-920e-aaf1e369c06e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:34.252784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1045/2120] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:34.253976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:34.265296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b0569-b4d1-4477-856b-a031c2fc5cbe admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:34.270242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:34.271794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:34.272071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:34.274922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] PATH_INFO: `/v3/projects/f0ae99c146ed47debf6100ee1926266f/users/94f7a1503d8b4e0dbe9adc68b1a878e7/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:34.289116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ae99c146ed47debf6100ee1926266f, user_id=94f7a1503d8b4e0dbe9adc68b1a878e7, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:34.292328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:34.360199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1076/2121] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:34 2022] PUT /identity/v3/projects/f0ae99c146ed47debf6100ee1926266f/users/94f7a1503d8b4e0dbe9adc68b1a878e7/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:20:34.370955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b83f-66d7-488b-952f-4efd8b9d6a72 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:34.372016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b83f-66d7-488b-952f-4efd8b9d6a72 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:34.372016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555b83f-66d7-488b-952f-4efd8b9d6a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:34.401579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8555b83f-66d7-488b-952f-4efd8b9d6a72 None None] MFA Rules not processed for user `94f7a1503d8b4e0dbe9adc68b1a878e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:34.402879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8555b83f-66d7-488b-952f-4efd8b9d6a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:34.470138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1046/2122] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:38.566833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:38.568396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:38.686230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fdea16-284a-4731-a04b-b7d85f9312ee admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:38.689862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:38.690512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:38.690789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:38.691060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:38.714735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:38.716460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeca3b9-8f21-4351-a0e6-157075b3989b service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:38.726197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1077/2123] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:43.465645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:43.466207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:43.466295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:43.468206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1047/2124] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:20:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:20:43.473778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:43.474254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:43.475522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:43.495017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] MFA Rules not processed for user `2d090a2340be4b6cbe533c22fbdf9057`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:43.495211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:43.516385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:43.573067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1078/2125] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:20:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:43.584276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:43.586437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:43.604235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77efad-68d6-4d02-88e9-7eb4646c8b23 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:43.609329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:43.609991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:43.610276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:43.610553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:43.619241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:43.620782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:43.631873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1048/2126] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:43.644396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:43.647250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:43.776909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd8819-71a0-49be-8685-4488626cb5e6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:43.781580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:43.782482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:43.782767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:43.783044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] PATH_INFO: `/v3/users/f2353d064cbf4c2d896a4e7dfb6b35b7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:43.784242 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2353d064cbf4c2d896a4e7dfb6b35b7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:43.786220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:44.020348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2353d064cbf4c2d896a4e7dfb6b35b7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.034851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2353d064cbf4c2d896a4e7dfb6b35b7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.141143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2353d064cbf4c2d896a4e7dfb6b35b7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.141797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2353d064cbf4c2d896a4e7dfb6b35b7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.150219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2353d064cbf4c2d896a4e7dfb6b35b7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.156324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1079/2127] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:43 2022] DELETE /identity/v3/users/f2353d064cbf4c2d896a4e7dfb6b35b7 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:44.417474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:44.431534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27f8e07-2326-4198-8e35-4d4d04051a03 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:44.494413 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:44.501610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:44.501610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:44.501610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] PATH_INFO: `/v3/projects/c7219d9790404986b60d60df5e23a6cb` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:44.501610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7219d9790404986b60d60df5e23a6cb)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:44.501610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:44.513066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:44.612768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7219d9790404986b60d60df5e23a6cb', 'request_id': 'req-4012e091-6237-4a34-b921-dd89fee07eee'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.620053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7219d9790404986b60d60df5e23a6cb', 'request_id': 'req-4012e091-6237-4a34-b921-dd89fee07eee'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.696183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7219d9790404986b60d60df5e23a6cb', 'request_id': 'req-4012e091-6237-4a34-b921-dd89fee07eee'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.708485 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] The token cache is being invalidate because project c7219d9790404986b60d60df5e23a6cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:44.708796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.712035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:44.714426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1049/2128] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:44 2022] DELETE /identity/v3/projects/c7219d9790404986b60d60df5e23a6cb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:44.718385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:44.719961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:44.732825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:44.736761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bd573-761c-40d0-9448-53e44faaa614 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:44.797803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:44.798680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:44.798963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:44.799241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] PATH_INFO: `/v3/users/50fc72f450ab4784935ed5b0554d628e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:44.800458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fc72f450ab4784935ed5b0554d628e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:44.802488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:44.996227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fc72f450ab4784935ed5b0554d628e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.007974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fc72f450ab4784935ed5b0554d628e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.088785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fc72f450ab4784935ed5b0554d628e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.089395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fc72f450ab4784935ed5b0554d628e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.096877 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-88a9a8b8-947a-4385-9b65-9219571c2216 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fc72f450ab4784935ed5b0554d628e'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.104079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1080/2129] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:20:44 2022] DELETE /identity/v3/users/50fc72f450ab4784935ed5b0554d628e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:45.365386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:45.366855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:45.380565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012e091-6237-4a34-b921-dd89fee07eee admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:45.450964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:45.451800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:45.452088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:45.452369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] PATH_INFO: `/v3/projects/16d2a4c66d074b21832bb5db89c16fbf` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:45.453688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d2a4c66d074b21832bb5db89c16fbf)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:45.456035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:45.599922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d2a4c66d074b21832bb5db89c16fbf', 'request_id': 'req-4b3edda0-ad22-440a-898c-b12973335fbc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.606144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d2a4c66d074b21832bb5db89c16fbf', 'request_id': 'req-4b3edda0-ad22-440a-898c-b12973335fbc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.667055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d2a4c66d074b21832bb5db89c16fbf', 'request_id': 'req-4b3edda0-ad22-440a-898c-b12973335fbc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.678814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] The token cache is being invalidate because project 16d2a4c66d074b21832bb5db89c16fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:20:45.679169 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.679803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4b3edda0-ad22-440a-898c-b12973335fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:20:45.685254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1050/2130] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:20:45 2022] DELETE /identity/v3/projects/16d2a4c66d074b21832bb5db89c16fbf => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:45.687026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:45.687312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:45.687596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:45.739300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:45.740493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:45.820760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1081/2131] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:20:45.828877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:45.829195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:45.829477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:45.848915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:45.850159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:45.858244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1051/2132] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:45.862541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:45.867599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:45.873551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7bfa1-1884-42b4-98f1-11f90a812e1b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:45.878283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:45.878944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:45.879224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:45.879499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:45.880226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:20:45.880532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:45.882240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:45.896376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1082/2133] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:20:45.900524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:45.909849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635f868-12d5-4b51-b4c1-be8b32d7fadd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:45.914544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:45.915256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:45.915552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:45.915827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:45.916578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:45.918665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:45.982673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1052/2134] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:45 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:45.986476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:45.997350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94dbf-63f8-45a6-bbb2-cd4c6cb973ca admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.053067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.053740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.054031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.054308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.055024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.057434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.119840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1083/2135] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:45 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:46.124095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.129829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:46.136317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023acd7-0092-406e-b3ed-a7b978595035 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.141478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.147765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.147765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.147765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.147765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.147765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.157232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1053/2136] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:46.161680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.172655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be3ab0-7e96-475f-843e-9a57e7bdca71 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.178337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.179134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.179434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.179711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.180544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.183050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb64c59-50a1-4027-a2ea-372a37613b2f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.194967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1084/2137] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:46.199298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.210156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc33b1-4a97-4045-b320-dd0d6776e482 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.214925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.215805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.216085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.216360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] PATH_INFO: `/v3/projects/7bd575b29a0a4464ade0121197023bec/users/d7634e4bfe9647229b35d6a4aaeda4f0/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.231948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd575b29a0a4464ade0121197023bec, user_id=d7634e4bfe9647229b35d6a4aaeda4f0, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.234744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.296343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1054/2138] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:46 2022] PUT /identity/v3/projects/7bd575b29a0a4464ade0121197023bec/users/d7634e4bfe9647229b35d6a4aaeda4f0/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:46.307630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.307942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.308218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.335332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] MFA Rules not processed for user `d7634e4bfe9647229b35d6a4aaeda4f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:46.336560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:46.403112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1085/2139] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:46.407873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.469528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a2e9-f0fb-4bcf-a90f-e150ecdb33e2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.474106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.474753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.475031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.475302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.475978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.478399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.567131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1055/2140] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:20:46 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:46.570989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.581981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5a942-85f7-4108-987b-7a311e27ec37 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.636795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:46.642638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.643307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.643588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.643859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.644543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.646481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.758142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1086/2141] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:20:46 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:20:46.762138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.772533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd54490-3e00-44de-b8ed-bc6be54907c2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.777630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.778323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.778606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.778885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.779612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.781212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.793278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1056/2142] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:46.797390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.808135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b5d5c8-8ac0-45f5-ade3-3ad2a136393d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.813009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.813922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.814207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.814483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] PATH_INFO: `/v3/projects/1950f7dfac8b442b99da1a73f53b6954/users/e17047ac81eb4446a99fe8be3d39517d/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.832205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1950f7dfac8b442b99da1a73f53b6954, user_id=e17047ac81eb4446a99fe8be3d39517d, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.835302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.901610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1087/2143] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:46 2022] PUT /identity/v3/projects/1950f7dfac8b442b99da1a73f53b6954/users/e17047ac81eb4446a99fe8be3d39517d/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:46.905417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:46.916650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0161fd7-d6bc-4842-92f9-2738a3c93087 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:46.974750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:46.975335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:46.975615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:46.975888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:46.976632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:46.978270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05844-d323-4ae1-b859-e8bda11841e9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:46.989398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1057/2144] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:20:46.993567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:47.004087 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f2f964-b21a-4a38-a88a-1797c4070098 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:47.009699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:47.010600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:47.010893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:47.011156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] PATH_INFO: `/v3/projects/1950f7dfac8b442b99da1a73f53b6954/users/e17047ac81eb4446a99fe8be3d39517d/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:47.013137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1950f7dfac8b442b99da1a73f53b6954, user_id=e17047ac81eb4446a99fe8be3d39517d, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:47.015845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:47.035775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1088/2145] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:20:46 2022] PUT /identity/v3/projects/1950f7dfac8b442b99da1a73f53b6954/users/e17047ac81eb4446a99fe8be3d39517d/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:20:47.039848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:47.040136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:47.040414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:47.068897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] MFA Rules not processed for user `e17047ac81eb4446a99fe8be3d39517d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:20:47.070215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:47.099064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:20:47.156040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1058/2146] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:20:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:20:47.167202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:47.169011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:47.231259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31984c7-2273-4be4-b442-2ac433f6b711 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:47.234941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:47.235590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:47.236020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:47.236301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:47.307817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:47.309284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:47.318246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1089/2147] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:55.558822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:20:55.560277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:20:55.572852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c8314-c6e5-4b49-8aac-07080b08f7c5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:20:55.580348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:20:55.580348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:20:55.580348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:20:55.580348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:20:55.588219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:20:55.589786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e4414-4e59-46cf-b1bb-fce6fde720f3 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:20:55.599781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1059/2148] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:20:55 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:20:57.314143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=66,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:04.066699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:04.137269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee747c7-0429-4b90-8365-b6d10cea6285 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:04.142016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:04.142884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:04.143162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:04.143439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] PATH_INFO: `/v3/users/d7634e4bfe9647229b35d6a4aaeda4f0` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:04.144634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7634e4bfe9647229b35d6a4aaeda4f0)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:04.146567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:04.525697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7634e4bfe9647229b35d6a4aaeda4f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:04.537409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7634e4bfe9647229b35d6a4aaeda4f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:04.632533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7634e4bfe9647229b35d6a4aaeda4f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:04.634769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7634e4bfe9647229b35d6a4aaeda4f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:04.641212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7634e4bfe9647229b35d6a4aaeda4f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:04.647186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1090/2149] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:04 2022] DELETE /identity/v3/users/d7634e4bfe9647229b35d6a4aaeda4f0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:04.651917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:04.652403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:04.652509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:04.669962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:04.671153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:04.732367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1060/2150] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:04.742814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:04.744375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:04.832361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44619a63-5ea8-4166-ac01-b8b8d85bed40 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:04.836050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:04.836697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:04.836975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:04.837249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:04.846804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:04.848251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d108324-e52f-4af6-9d1b-f2d90a082467 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:04.858784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1091/2151] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:21:05.280360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:05.282020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:05.295628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92356328-7d17-4539-8ab3-7b86557f5ad1 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:05.301032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:05.302118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:05.302532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:05.302950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] PATH_INFO: `/v3/projects/7bd575b29a0a4464ade0121197023bec` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:05.304540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd575b29a0a4464ade0121197023bec)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:05.306466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:05.395906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:05.396461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:05.396461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:05.404034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:05.434364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd575b29a0a4464ade0121197023bec', 'request_id': 'req-fa05208d-f293-4797-abc4-78d0c7ee47c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.436619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:05.437890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:05.441657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd575b29a0a4464ade0121197023bec', 'request_id': 'req-fa05208d-f293-4797-abc4-78d0c7ee47c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.522359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1092/2152] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:21:05.551073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:05.554330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:05.558518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd575b29a0a4464ade0121197023bec', 'request_id': 'req-fa05208d-f293-4797-abc4-78d0c7ee47c5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.580792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] The token cache is being invalidate because project 7bd575b29a0a4464ade0121197023bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:05.581083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.581740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.583663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1061/2153] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:05 2022] DELETE /identity/v3/projects/7bd575b29a0a4464ade0121197023bec => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:05.587364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:05.589668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:05.606721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05208d-f293-4797-abc4-78d0c7ee47c5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:05.611662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:05.612578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:05.612858 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:05.613135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] PATH_INFO: `/v3/users/e17047ac81eb4446a99fe8be3d39517d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:05.614394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17047ac81eb4446a99fe8be3d39517d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:05.616449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:05.678131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e302d7-6fd9-4d44-846e-4d0109b88b4a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:05.684115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:05.684754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:05.685030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:05.685322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:05.687280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:05.699341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:05.701188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:05.711001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1093/2154] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:05.727565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:05.825340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17047ac81eb4446a99fe8be3d39517d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.840846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17047ac81eb4446a99fe8be3d39517d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.981104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17047ac81eb4446a99fe8be3d39517d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.989621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17047ac81eb4446a99fe8be3d39517d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.990339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-905fd67f-1615-4173-8142-52bfaeb51ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17047ac81eb4446a99fe8be3d39517d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:05.999950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1062/2155] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:05 2022] DELETE /identity/v3/users/e17047ac81eb4446a99fe8be3d39517d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:21:06.407049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:06.429209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c5c1-0fa1-434a-a2fb-a02840ba1be1 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:06.512030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:06.522030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:06.522979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:06.523329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:06.523715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] PATH_INFO: `/v3/projects/1950f7dfac8b442b99da1a73f53b6954` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:06.524964 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1950f7dfac8b442b99da1a73f53b6954)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:06.527009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:06.673241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1950f7dfac8b442b99da1a73f53b6954', 'request_id': 'req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:06.680918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1950f7dfac8b442b99da1a73f53b6954', 'request_id': 'req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:06.687743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1950f7dfac8b442b99da1a73f53b6954', 'request_id': 'req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:06.832147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] The token cache is being invalidate because project 1950f7dfac8b442b99da1a73f53b6954 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:06.832436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:06.833080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:06.834656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1094/2156] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:06 2022] DELETE /identity/v3/projects/1950f7dfac8b442b99da1a73f53b6954 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:06.944514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ad16-dd84-4a7e-8440-a676650e17f5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:06.945089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ad16-dd84-4a7e-8440-a676650e17f5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:06.945330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1ad16-dd84-4a7e-8440-a676650e17f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:06.967633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-67f1ad16-dd84-4a7e-8440-a676650e17f5 None None] MFA Rules not processed for user `a7c271c1c0014af0bfc280e36135ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:06.968895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-67f1ad16-dd84-4a7e-8440-a676650e17f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:07.043756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1063/2157] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:21:08.737420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:08.738961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:08.809694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b190be-c1ff-4d95-85dc-b5ce26cf78fc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:08.814584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:08.815465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:08.815744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:08.816020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] PATH_INFO: `/v3/users/94f7a1503d8b4e0dbe9adc68b1a878e7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:08.817230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f7a1503d8b4e0dbe9adc68b1a878e7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:08.819188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:09.063318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f7a1503d8b4e0dbe9adc68b1a878e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:09.075508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f7a1503d8b4e0dbe9adc68b1a878e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:09.232355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f7a1503d8b4e0dbe9adc68b1a878e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:09.232968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f7a1503d8b4e0dbe9adc68b1a878e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:09.240988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f7a1503d8b4e0dbe9adc68b1a878e7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:09.247905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1095/2158] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:08 2022] DELETE /identity/v3/users/94f7a1503d8b4e0dbe9adc68b1a878e7 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:09.253817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:09.255862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:09.255862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:09.274148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:09.276267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:09.344029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1064/2159] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:09.355604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:09.357789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:09.363738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:09.428401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c8e16-94ad-4494-9d3e-ac8cff2ac803 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:09.433241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:09.434071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:09.434361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:09.434830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:09.444637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:09.446138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e01d9-e151-42aa-a4b7-289c5155919c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:09.458667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1096/2160] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:10.029656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:10.033135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:10.058208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990de8e-ae04-4fcf-b066-41220540cc57 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:10.069024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:10.069994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.070275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.070553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] PATH_INFO: `/v3/projects/f0ae99c146ed47debf6100ee1926266f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.071952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ae99c146ed47debf6100ee1926266f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:10.074444 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:10.242803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:10.246634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ae99c146ed47debf6100ee1926266f', 'request_id': 'req-7ba4736a-8b09-4d0a-8ebd-984b4a275586'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:10.254232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ae99c146ed47debf6100ee1926266f', 'request_id': 'req-7ba4736a-8b09-4d0a-8ebd-984b4a275586'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:10.381341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ae99c146ed47debf6100ee1926266f', 'request_id': 'req-7ba4736a-8b09-4d0a-8ebd-984b4a275586'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:10.395267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] The token cache is being invalidate because project f0ae99c146ed47debf6100ee1926266f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:10.395557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:10.396225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-7ba4736a-8b09-4d0a-8ebd-984b4a275586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:10.397850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1065/2161] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:10 2022] DELETE /identity/v3/projects/f0ae99c146ed47debf6100ee1926266f => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:10.404488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.405310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.406155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.434393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:10.436178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:10.512368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1097/2162] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:10.520050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.520337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.520641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.540014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:10.547982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:10.549412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1066/2163] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:10.553739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:10.564342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772de3d0-c8f6-4f2a-ba60-5e58c9bb17c7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:10.569805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:10.570474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.570750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.571020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.571741 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:21:10.572045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:10.574413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:10.591831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1098/2164] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:21:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:21:10.593037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:10.603680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa4501-97c9-48c8-94a6-b5cb09228c05 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:10.608545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:10.609196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.609471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.609764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.610449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:10.612333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ea7a0-28cf-4482-a079-caf41b945075 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:10.857802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1067/2165] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:21:10 2022] POST /identity/v3/projects => generated 383 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:21:10.864618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:10.873195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b385c2-5f4c-4461-b590-e30555ca254e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:10.878328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.878660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.879060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.897017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:10.898262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:10.953545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:10.954690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:10.955300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:10.955681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:10.956585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:10.958822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:10.970842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1068/2166] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:10.991911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:10.993714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:11.071886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1099/2167] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:21:10 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:21:11.076119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:11.076258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5f943-bb9c-47aa-852d-145fd786af79 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.084033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.084999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.085420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.086073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.090934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a413146-882b-4c8e-b9a0-ef56c91ad90d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.096646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.097539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.097654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.100250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.100250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.100462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.100726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.101100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.114983 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1069/2168] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:11.118151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1100/2169] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:21:11.118727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:11.133219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b463-2a20-4402-923b-406c69dfb706 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.138796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.139999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.140303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.140786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.141771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.143455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f44cc3-3621-4d2b-b8c0-7b2267fb70f8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.155640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1070/2170] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:21:11.159839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:11.173118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8cf5db-083f-4581-9dd9-985f2bcc17f9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.181044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.182863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.183294 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.183759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] PATH_INFO: `/v3/projects/cd0f9508808d467a91ccc9963f1605ef/users/f6cd563d00da490e9424efffcacc551d/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.194767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:11.209572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f9508808d467a91ccc9963f1605ef, user_id=f6cd563d00da490e9424efffcacc551d, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.229250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.324891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1101/2171] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:21:11 2022] PUT /identity/v3/projects/cd0f9508808d467a91ccc9963f1605ef/users/f6cd563d00da490e9424efffcacc551d/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:11.341160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.341681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.341823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.368975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] MFA Rules not processed for user `f6cd563d00da490e9424efffcacc551d`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:11.370651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:11.379114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:11.449311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1071/2172] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:11.464430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:11.466823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:11.512675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:11.514435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:11.556304 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98b849-0d82-4050-8062-5cc47c12ddf4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.560815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.561558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.561944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.562228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.571949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.574063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eba40-0f13-4716-82ef-9555c45525d7 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.584600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1102/2173] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:11.592466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2194a2b-22e2-40b1-917a-978a2426b3f7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:11.599756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:11.604394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.604394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.604394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] PATH_INFO: `/v3/users/0df1bfa96fd84173a6e75d34f6c57dad` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.604394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df1bfa96fd84173a6e75d34f6c57dad)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:11.605518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:11.803526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df1bfa96fd84173a6e75d34f6c57dad'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:11.820683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df1bfa96fd84173a6e75d34f6c57dad'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:11.923731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df1bfa96fd84173a6e75d34f6c57dad'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:11.931405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df1bfa96fd84173a6e75d34f6c57dad'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:11.932703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df1bfa96fd84173a6e75d34f6c57dad'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:11.938655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1072/2174] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:11 2022] DELETE /identity/v3/users/0df1bfa96fd84173a6e75d34f6c57dad => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:21:11.949022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582f4f-da09-4880-971b-968a1908997b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:11.949298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582f4f-da09-4880-971b-968a1908997b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:11.949581 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582f4f-da09-4880-971b-968a1908997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:11.968389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-19582f4f-da09-4880-971b-968a1908997b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:11.969645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-19582f4f-da09-4880-971b-968a1908997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:12.043286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1103/2175] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:12.054518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:12.055921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:12.104165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:12.131819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f358e-3678-4ec3-acf5-8fbee99c76c5 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:12.136406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:12.137077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:12.137359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:12.137638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:12.148310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:12.149689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cdcca4-6111-4e8d-a79b-d621a0c9c7ad service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:12.162692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1073/2176] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:12.811328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582f4f-da09-4880-971b-968a1908997b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:12.812825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-19582f4f-da09-4880-971b-968a1908997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:12.825195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582f4f-da09-4880-971b-968a1908997b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:12.830427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:12.831292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:12.831573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:12.831864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] PATH_INFO: `/v3/projects/19f4e394a2c64e959994685eec5d020e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:12.833046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f4e394a2c64e959994685eec5d020e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:12.835000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:12.970151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f4e394a2c64e959994685eec5d020e', 'request_id': 'req-79afbe29-6e2e-411a-a7ab-cf441945f688'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:12.976396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f4e394a2c64e959994685eec5d020e', 'request_id': 'req-79afbe29-6e2e-411a-a7ab-cf441945f688'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:12.982537 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f4e394a2c64e959994685eec5d020e', 'request_id': 'req-79afbe29-6e2e-411a-a7ab-cf441945f688'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:12.984969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:13.071547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] The token cache is being invalidate because project 19f4e394a2c64e959994685eec5d020e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:13.071832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:13.072453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:13.074619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1104/2177] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:12 2022] DELETE /identity/v3/projects/19f4e394a2c64e959994685eec5d020e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:16.170513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:16.170513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:16.170513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:16.187774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:16.188951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:16.266802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1074/2178] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:16.298305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:16.299914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:16.374683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afbe29-6e2e-411a-a7ab-cf441945f688 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:16.380025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:16.383871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:16.383871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:16.383871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:16.390598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:16.392375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4059d608-b261-4a8a-98c2-4ada630bb143 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:16.402645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1105/2179] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:19.579787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:19.580817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:19.593358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb82ad-a68b-4e5d-aa69-03d9ecc078c4 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:19.598246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583231-f762-4143-870a-adb52d83585b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:19.599109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583231-f762-4143-870a-adb52d83585b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:19.599388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583231-f762-4143-870a-adb52d83585b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:19.599660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583231-f762-4143-870a-adb52d83585b admin admin] PATH_INFO: `/v3/users/f6cd563d00da490e9424efffcacc551d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:19.600887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00583231-f762-4143-870a-adb52d83585b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6cd563d00da490e9424efffcacc551d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:19.602874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00583231-f762-4143-870a-adb52d83585b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:19.807193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6cd563d00da490e9424efffcacc551d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:19.822774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6cd563d00da490e9424efffcacc551d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:19.915103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6cd563d00da490e9424efffcacc551d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:19.940862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6cd563d00da490e9424efffcacc551d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:19.941795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6cd563d00da490e9424efffcacc551d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:19.956507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1075/2180] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:19 2022] DELETE /identity/v3/users/f6cd563d00da490e9424efffcacc551d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:19.961321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:19.966156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:19.966156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:19.983048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:19.984184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:20.056106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1106/2181] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:20.066456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:20.068009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:20.133946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:20.148979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583231-f762-4143-870a-adb52d83585b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:20.154106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:20.154762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:20.155056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:20.155319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:20.166868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:20.168543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b81b5-9ae4-4573-91c4-bf7c933e6ba0 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:20.183260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1076/2182] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:20.737566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:20.740563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:20.751992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85571ac2-05f5-41e0-8565-14ef25cf78fb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:20.757361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:20.758470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:20.758758 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:20.759039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] PATH_INFO: `/v3/projects/cd0f9508808d467a91ccc9963f1605ef` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:20.760403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0f9508808d467a91ccc9963f1605ef)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:20.762505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:20.902003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0f9508808d467a91ccc9963f1605ef', 'request_id': 'req-a6855b65-99de-4a2b-9b9b-89f70f728504'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:20.908633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0f9508808d467a91ccc9963f1605ef', 'request_id': 'req-a6855b65-99de-4a2b-9b9b-89f70f728504'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:20.914676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0f9508808d467a91ccc9963f1605ef', 'request_id': 'req-a6855b65-99de-4a2b-9b9b-89f70f728504'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:21.044149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] The token cache is being invalidate because project cd0f9508808d467a91ccc9963f1605ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:21.044794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:21.045112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a6855b65-99de-4a2b-9b9b-89f70f728504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:21.046753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1107/2183] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:20 2022] DELETE /identity/v3/projects/cd0f9508808d467a91ccc9963f1605ef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:21.051759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.052204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.052316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.070015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:21.071263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:21.130509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1077/2184] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:21:21.138449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.138742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.139031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.145497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:21.158622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:21.159837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:21.168593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1108/2185] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:21.172919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.186439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fae6de-d736-46b5-a4da-f54e8f138e89 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.191156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.191817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.192098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.192378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.193103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:21:21.193414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.195053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.207595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1078/2186] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:21:21.212177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.222267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a2598-825f-476b-8c78-f5d9218b11cf None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.227089 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.227747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.228049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.228320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.229602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.231594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.342065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1109/2187] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:21:21 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:21:21.346459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.357314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8118fa-ad1a-488c-8a20-1a59f8812947 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.415685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.416360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.416647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.416919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.417613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.419586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.634904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1079/2188] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:21:21 2022] POST /identity/v3/users => generated 292 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:21:21.637813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.647943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01025515-00b0-429e-8878-667471d1edcb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.653138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.653823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.654103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.654406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.655130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.656725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.666694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1110/2189] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:21:21.670746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.681020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06dc4f-3d66-4159-a0d7-c8ba266e914f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.685565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.686248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.686532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.686807 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.687528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.689161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806a4e7-65bc-44c0-85ea-1dd2f0ac9acf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.699884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1080/2190] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:21:21.704123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.715001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19a12e-d6dc-45f0-a4a1-08ca09b0afc7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:21.719690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:21.720559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.720836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.721107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] PATH_INFO: `/v3/projects/112d6eabc2724fe38bbf268a58385dd7/users/bf7789bfbe4a4de982c133c69f7e692e/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.735486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=112d6eabc2724fe38bbf268a58385dd7, user_id=bf7789bfbe4a4de982c133c69f7e692e, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:21.738141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:21.850152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1111/2191] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:21:21 2022] PUT /identity/v3/projects/112d6eabc2724fe38bbf268a58385dd7/users/bf7789bfbe4a4de982c133c69f7e692e/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:21.861756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e04d5-35fa-48e9-bd72-149f569367e1 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:21.862046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e04d5-35fa-48e9-bd72-149f569367e1 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:21.862326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e04d5-35fa-48e9-bd72-149f569367e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:21.889712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-657e04d5-35fa-48e9-bd72-149f569367e1 None None] MFA Rules not processed for user `bf7789bfbe4a4de982c133c69f7e692e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:21.890895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-657e04d5-35fa-48e9-bd72-149f569367e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:21.933669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:21.961231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1081/2192] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:21.973613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:21.975422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:22.040055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d7a76c-6a22-425b-a83c-939ebbda96b9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:22.044564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:22.045284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:22.045654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:22.046038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:22.055786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:22.057381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:22.067301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1112/2193] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:22.157329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:22.159954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:22.159954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:22.177107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:22.178390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:22.245545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1082/2194] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:22.270458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:22.271951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:22.350744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bde62-32cf-4ebd-8324-fbc3c9bcd7d0 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:22.356582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:22.357228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:22.357512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:22.357822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:22.366393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:22.367980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31e16e-df26-4ed5-9c25-d425c78f6a8f service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:22.378029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1113/2195] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:26.199223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:26.209543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5a9db-061e-4925-b500-5c315333e13c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:26.214763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:26.215644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:26.215924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:26.216204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] PATH_INFO: `/v3/users/bf7789bfbe4a4de982c133c69f7e692e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:26.218800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7789bfbe4a4de982c133c69f7e692e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:26.228689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:26.492631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7789bfbe4a4de982c133c69f7e692e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:26.504739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7789bfbe4a4de982c133c69f7e692e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:26.622001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7789bfbe4a4de982c133c69f7e692e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:26.630319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7789bfbe4a4de982c133c69f7e692e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:26.631146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7789bfbe4a4de982c133c69f7e692e'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:26.637951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1083/2196] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:26 2022] DELETE /identity/v3/users/bf7789bfbe4a4de982c133c69f7e692e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:26.642797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:26.643290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:26.643391 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:26.661051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:26.662288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:26.683563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:26.724972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1114/2197] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:26.735075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:26.736491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:26.798285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d439733-983e-42e1-9433-efbd0e27d59d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:26.801970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:26.802666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:26.802953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:26.803232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:26.812903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:26.814384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9dbcb-7fbf-461d-9eba-6f2b0c7d98c6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:26.824997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1084/2198] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:26.826079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:27.319967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:27.321492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.335945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f181-8456-40eb-be0d-9979c2529fd5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:27.341869 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:27.345441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.345441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.345441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] PATH_INFO: `/v3/projects/112d6eabc2724fe38bbf268a58385dd7` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.345441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] RBAC: Authorizing `identity:delete_project(project_id=112d6eabc2724fe38bbf268a58385dd7)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:27.346955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:27.477368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.477932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.478122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.510707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:27.511979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.526690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '112d6eabc2724fe38bbf268a58385dd7', 'request_id': 'req-be3bb1cf-9c06-4832-b7bf-709646b2302d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:27.535256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '112d6eabc2724fe38bbf268a58385dd7', 'request_id': 'req-be3bb1cf-9c06-4832-b7bf-709646b2302d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:27.543205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '112d6eabc2724fe38bbf268a58385dd7', 'request_id': 'req-be3bb1cf-9c06-4832-b7bf-709646b2302d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:27.574308 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1085/2199] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:27.596200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:27.597710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.655406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] The token cache is being invalidate because project 112d6eabc2724fe38bbf268a58385dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:27.656044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:27.656606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-be3bb1cf-9c06-4832-b7bf-709646b2302d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:27.658849 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1115/2200] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:27 2022] DELETE /identity/v3/projects/112d6eabc2724fe38bbf268a58385dd7 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:27.668238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650072-f5e9-47ae-9c69-2105f3f97b7c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.668238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650072-f5e9-47ae-9c69-2105f3f97b7c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.668238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe650072-f5e9-47ae-9c69-2105f3f97b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.676440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73b772-3914-4ebf-ad2a-74aacf126ce7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:27.683138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:27.683798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.684131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.684410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.685169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fe650072-f5e9-47ae-9c69-2105f3f97b7c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:27.686258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.686403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fe650072-f5e9-47ae-9c69-2105f3f97b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.699417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1116/2201] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:27.702834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:27.704877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:27.705811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.706051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.706367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.717281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1086/2202] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:21:27.726886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:27.728384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:27.739483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1117/2203] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:21:27.742581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:27.753072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ab874-c3f5-46e1-94b2-c0632be26421 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:27.758035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:27.763269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:27.775106 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1087/2204] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:21:27.780531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:27.792215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fcfed-2d15-4bc3-be39-263ec35bd9d4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:27.797711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:27.798524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:27.798808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:27.799085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:27.799801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:27.801821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:27.940035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1118/2205] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:21:27 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:21:27.941213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:27.951491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6814bb-6e02-4552-92e7-5d52e47e7cec admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:28.010459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:28.011449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.011959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.013237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.013899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:28.016481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:28.142439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:28.147821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1088/2206] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:21:27 2022] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:21:28.152697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:28.163124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8df06-4ed6-4547-88ff-b82bc4cebf1c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:28.167707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:28.168392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.168676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.168960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.169691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:28.171332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:28.182284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1119/2207] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:21:28.187580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:28.198114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef44d2e-84a1-4067-aee1-47d34c408580 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:28.202822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:28.203758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.204480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.205142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.206070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:28.207636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be9f5a-8498-4304-89b9-abee8b3a3d87 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:28.218563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1089/2208] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:21:28.222822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:28.233271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6643b-5be8-437d-8014-fb4a1b674885 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:28.237840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:28.238712 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.238988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.239257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] PATH_INFO: `/v3/projects/14be827c89b14084a64dc3142398963e/users/2d79907f5eef44ee9cc18d4f08c67335/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.255616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14be827c89b14084a64dc3142398963e, user_id=2d79907f5eef44ee9cc18d4f08c67335, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:28.259397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:28.342000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1120/2209] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:21:28 2022] PUT /identity/v3/projects/14be827c89b14084a64dc3142398963e/users/2d79907f5eef44ee9cc18d4f08c67335/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:28.352216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68519c-3b0c-475c-ac7f-9016226c1af6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.352511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68519c-3b0c-475c-ac7f-9016226c1af6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.352871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68519c-3b0c-475c-ac7f-9016226c1af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.379219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7e68519c-3b0c-475c-ac7f-9016226c1af6 None None] MFA Rules not processed for user `2d79907f5eef44ee9cc18d4f08c67335`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:28.380433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e68519c-3b0c-475c-ac7f-9016226c1af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:28.445337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1090/2210] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:28.456784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:28.458512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:28.502785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:28.518756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855991b-01bc-4a32-bca6-3e21b82aa18f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:28.520623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:28.521267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:28.521548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:28.521861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:28.530292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:28.531746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:28.541253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1121/2211] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:32.802632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e201b-9ca9-429a-841d-50259b6b6bff None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:32.803131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e201b-9ca9-429a-841d-50259b6b6bff None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:32.805424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e201b-9ca9-429a-841d-50259b6b6bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:32.821259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ee3e201b-9ca9-429a-841d-50259b6b6bff None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:32.822562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ee3e201b-9ca9-429a-841d-50259b6b6bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:32.901607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1091/2212] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:21:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:32.923950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:32.925511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:33.005474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fabac5-1721-4062-ab53-83baadd92b90 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:33.015257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279372-7273-45ca-ae24-82720c73559d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:33.015257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279372-7273-45ca-ae24-82720c73559d service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:33.015257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279372-7273-45ca-ae24-82720c73559d service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:33.015257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50279372-7273-45ca-ae24-82720c73559d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:33.022338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279372-7273-45ca-ae24-82720c73559d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:33.024159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50279372-7273-45ca-ae24-82720c73559d service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:33.034235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1122/2213] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:35.120083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:35.120573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:35.120683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:35.138823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] MFA Rules not processed for user `b7c7538bc2bb4906932e73b56d71e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:35.140029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:35.196248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1092/2214] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:37.247165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279372-7273-45ca-ae24-82720c73559d service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:37.249196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-50279372-7273-45ca-ae24-82720c73559d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:37.342410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50279372-7273-45ca-ae24-82720c73559d service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:37.348727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:37.349374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:37.349662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:37.349998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:37.352010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:37.364705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:37.366270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241689a5-e1be-43f5-8284-0ef271111807 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:37.377639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1123/2215] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:41.217084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:41.228199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da377ce7-b136-4e7f-aa55-95b5e33142ef None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:41.233929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:41.234808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:41.235089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:41.235384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] PATH_INFO: `/v3/users/2d79907f5eef44ee9cc18d4f08c67335` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:41.237107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d79907f5eef44ee9cc18d4f08c67335)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:41.239370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:41.263421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:41.475562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d79907f5eef44ee9cc18d4f08c67335'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:41.487544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d79907f5eef44ee9cc18d4f08c67335'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:41.564581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d79907f5eef44ee9cc18d4f08c67335'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:41.572872 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d79907f5eef44ee9cc18d4f08c67335'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:41.573759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d79907f5eef44ee9cc18d4f08c67335'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:41.580731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1093/2216] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:21:41 2022] DELETE /identity/v3/users/2d79907f5eef44ee9cc18d4f08c67335 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:41.585521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:41.586052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:41.586052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:41.605277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:41.608864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:41.642665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:41.671514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1124/2217] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:21:41.681468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:41.683559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:41.753636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf32035c-6a59-4fc7-8056-622d61fde257 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:41.759241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:41.759898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:41.760183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:41.760461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:41.773527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:41.775017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a43ed-26ac-4d51-9ec4-078a88b265a6 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:41.785925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1094/2218] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:21:42.235250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:21:42.236708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:42.250085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c92632-0f1f-475b-b1d3-b983d7140c98 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:21:42.268245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:21:42.269347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:42.269639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:42.270065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] PATH_INFO: `/v3/projects/14be827c89b14084a64dc3142398963e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:42.271283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14be827c89b14084a64dc3142398963e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:21:42.273270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:21:42.395833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14be827c89b14084a64dc3142398963e', 'request_id': 'req-1627fb96-6e9f-4475-8f04-2716586b08e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:42.402966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14be827c89b14084a64dc3142398963e', 'request_id': 'req-1627fb96-6e9f-4475-8f04-2716586b08e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:42.409656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14be827c89b14084a64dc3142398963e', 'request_id': 'req-1627fb96-6e9f-4475-8f04-2716586b08e3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:42.482552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] The token cache is being invalidate because project 14be827c89b14084a64dc3142398963e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:21:42.482870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:42.483500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1627fb96-6e9f-4475-8f04-2716586b08e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:21:42.485056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1125/2219] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:21:42 2022] DELETE /identity/v3/projects/14be827c89b14084a64dc3142398963e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:21:51.780984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=8,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:52.478770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:21:55.680081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:21:55.680640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:21:55.680640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:21:55.698537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] MFA Rules not processed for user `e63c56eb2f5944d88ea4521fad5294d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:21:55.699765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:21:55.756956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1095/2220] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:21:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:05.749980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=25 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:14.739852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2efaf-f025-4296-bd63-0fa50162d785 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:14.739852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2efaf-f025-4296-bd63-0fa50162d785 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:14.739852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2efaf-f025-4296-bd63-0fa50162d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:14.812750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-06a2efaf-f025-4296-bd63-0fa50162d785 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:14.814009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-06a2efaf-f025-4296-bd63-0fa50162d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:14.894403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1126/2221] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:22:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:14.937261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:14.938745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:15.038876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18101379-6825-4ca6-85b2-922f3a625d22 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:15.044098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:15.044745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:15.045025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:15.045297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:15.054278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:15.055887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:15.065004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1096/2222] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:22:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:22:19.755808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f461-c033-4054-af23-69cbdce63bfc None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:19.756420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f461-c033-4054-af23-69cbdce63bfc None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:19.756420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7835f461-c033-4054-af23-69cbdce63bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:19.785568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7835f461-c033-4054-af23-69cbdce63bfc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:19.786891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7835f461-c033-4054-af23-69cbdce63bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:19.889184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1127/2223] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:19.917746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:19.920099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:20.024281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6525ce-2a53-4f96-bd7e-1b2d355877d1 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:20.029973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:20.030759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:20.031045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:20.031329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:20.040949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:20.042625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:20.053536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1097/2224] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:25.990463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e733-9953-4369-8591-38bd1014bca4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:25.991487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e733-9953-4369-8591-38bd1014bca4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:25.991956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e733-9953-4369-8591-38bd1014bca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:26.012512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2968e733-9953-4369-8591-38bd1014bca4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:26.013811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2968e733-9953-4369-8591-38bd1014bca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:26.023825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1128/2225] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:26.044971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:26.060433 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fab590-41b2-4196-ad88-1a87a455e141 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:26.069219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:26.070605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:26.070960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:26.071309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:26.080838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:26.083488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:26.093412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1098/2226] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:31.282161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f294-1cb6-4ee8-90d9-e19157d2b58d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:31.282608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f294-1cb6-4ee8-90d9-e19157d2b58d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:31.282710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0f294-1cb6-4ee8-90d9-e19157d2b58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:31.301515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-15d0f294-1cb6-4ee8-90d9-e19157d2b58d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:31.302684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-15d0f294-1cb6-4ee8-90d9-e19157d2b58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:31.311596 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1129/2227] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:31.335347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:31.347006 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8646604-9cc4-4ad6-b1b8-e2cf046da18c service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:31.352781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:31.353426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:31.353710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:31.354111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:31.364409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:31.366057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bbdc3e-0e3d-43e1-b350-c60a557fcebe service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:31.377538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1099/2228] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:35.844826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:35.845371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:35.845493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:35.846861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1130/2229] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:22:35.853258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23d0a-03e2-4624-9e46-436507ebae7f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:35.853805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23d0a-03e2-4624-9e46-436507ebae7f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:35.853805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e23d0a-03e2-4624-9e46-436507ebae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:35.894765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c8e23d0a-03e2-4624-9e46-436507ebae7f None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:35.895984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c8e23d0a-03e2-4624-9e46-436507ebae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:35.905173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1100/2230] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:22:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:22:35.916813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:35.921760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:35.978450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:36.001234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea8102-4a75-44ee-adf5-ae1f342bae1f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:36.005061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:36.005696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.006015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.006285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.016860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:36.018355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d839cec-e2c8-46db-bdc8-de64fa043c94 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:36.028826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1131/2231] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:36.254623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.254623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.254623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.255099 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1101/2232] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:22:36.259942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02028e-2dc4-4024-8ae6-9c795e3d0953 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.260223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02028e-2dc4-4024-8ae6-9c795e3d0953 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.260496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02028e-2dc4-4024-8ae6-9c795e3d0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.279168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-be02028e-2dc4-4024-8ae6-9c795e3d0953 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:36.280386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-be02028e-2dc4-4024-8ae6-9c795e3d0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:36.331480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1132/2233] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:36.343469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:36.345213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:36.353239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:36.359140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78321319-a4a1-41ff-afd2-b4984f5f39e8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:36.369965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:36.369965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.369965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.369965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.372053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:36.373478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899acb2-3a6b-483c-a33e-b5509d8ff060 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:36.381984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1102/2234] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:36.467887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98917-49ef-4648-abed-9f96ffa8356f None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.468178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98917-49ef-4648-abed-9f96ffa8356f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.468482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e98917-49ef-4648-abed-9f96ffa8356f None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.470032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1133/2235] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:22:36.475210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cf3b-d29b-47d3-a612-00e1898ee604 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.475498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cf3b-d29b-47d3-a612-00e1898ee604 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.475804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5cf3b-d29b-47d3-a612-00e1898ee604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.494593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6ac5cf3b-d29b-47d3-a612-00e1898ee604 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:36.495800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6ac5cf3b-d29b-47d3-a612-00e1898ee604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:36.505582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1103/2236] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:36.516646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e98917-49ef-4648-abed-9f96ffa8356f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:36.528689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e98917-49ef-4648-abed-9f96ffa8356f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:36.532461 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:36.537822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.537822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.537822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.545305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:36.546780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:36.557890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1134/2237] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:36.585598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aed07-3e5f-494a-906b-f13cd9fc63e5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.585961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aed07-3e5f-494a-906b-f13cd9fc63e5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.586246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84aed07-3e5f-494a-906b-f13cd9fc63e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.606296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f84aed07-3e5f-494a-906b-f13cd9fc63e5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:36.607528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f84aed07-3e5f-494a-906b-f13cd9fc63e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:36.616382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1104/2238] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:36.638132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:36.639577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:36.654757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1a7fe-a61d-41cb-b6a0-d40151fa0edc service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:36.660320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:36.660947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:36.661223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:36.661491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:36.671060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:36.672671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:36.683280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1135/2239] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:40.901394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1142-6908-4209-af7f-b180a84320b8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:40.902087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1142-6908-4209-af7f-b180a84320b8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:40.902087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd1142-6908-4209-af7f-b180a84320b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:40.921034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-76cd1142-6908-4209-af7f-b180a84320b8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:40.922290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-76cd1142-6908-4209-af7f-b180a84320b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:40.931283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1105/2240] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jun 24 15:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:40.958490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:40.970215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93283f71-4bb2-4c09-bd98-cbfa3e287387 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:40.976041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:40.976672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:40.976952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:40.977236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:40.986539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:40.988176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:40.997978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1136/2241] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:22:45.490633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf874-05ee-49f1-821e-011a3be089fe None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:45.491126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf874-05ee-49f1-821e-011a3be089fe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:45.491396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbf874-05ee-49f1-821e-011a3be089fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:45.510423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-85fbf874-05ee-49f1-821e-011a3be089fe None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:22:45.511630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-85fbf874-05ee-49f1-821e-011a3be089fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:22:45.518819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1106/2242] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:22:45.530742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:22:45.542159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20876e54-6a27-4281-a8f4-27c1a48f574e service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:22:45.547149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:22:45.547787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:22:45.548071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:22:45.548482 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:22:45.557781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:22:45.559443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:22:45.569860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1137/2243] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:22:55.504643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=17 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:22:55.564952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=59 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:14.941940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:14.942506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:14.942659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:14.966035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:23:14.967735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:14.975269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1107/2244] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:23:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:23:15.000670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:15.011450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4abd78-9cb2-4c56-aa90-68ad1149b46a service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:15.016484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:15.017123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:15.017409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:15.017687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:15.025923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:15.027555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f8a64-f7f0-4615-9337-689da6f998cb service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:15.035592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1138/2245] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:23:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:23:24.960027 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:25.032333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:34.569969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:34.571428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:34.585000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a299fc67-1f30-4e08-8045-c07042061dda None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:34.588765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:34.589386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:34.589848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:34.590128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:34.591926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:34.606297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:34.607718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:34.618679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1108/2246] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:23:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:23:35.827402 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:35.832167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:35.832863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:35.870326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] MFA Rules not processed for user `a7c271c1c0014af0bfc280e36135ce20`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:23:35.872203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:35.949021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1139/2247] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:23:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:23:36.335200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:36.343974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717bd4ee-f549-4675-910a-3a7c5783f212 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:36.348182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:36.348814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:36.349097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:36.349377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:36.351403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:36.366341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:36.367874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:36.380924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1109/2248] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:23:39.215617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:39.217211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:39.235572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b70807-6f1d-4657-b4cf-b1677bab50d6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:39.240098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:39.241589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:39.241589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:39.241589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] PATH_INFO: `/v3/users/e63c56eb2f5944d88ea4521fad5294d4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:39.242787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63c56eb2f5944d88ea4521fad5294d4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:39.244695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:39.411518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63c56eb2f5944d88ea4521fad5294d4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:39.424500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63c56eb2f5944d88ea4521fad5294d4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:39.490338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63c56eb2f5944d88ea4521fad5294d4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:39.491138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63c56eb2f5944d88ea4521fad5294d4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:39.509699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63c56eb2f5944d88ea4521fad5294d4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:39.517989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1140/2249] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:23:39 2022] DELETE /identity/v3/users/e63c56eb2f5944d88ea4521fad5294d4 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:23:39.791375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:39.809890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b64417-52be-42ea-b1b4-7e878ee4963e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:39.873511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:39.874438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:39.877001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:39.877001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] PATH_INFO: `/v3/projects/20199841e2764e499c24b7933d7878d9` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:39.877001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] RBAC: Authorizing `identity:delete_project(project_id=20199841e2764e499c24b7933d7878d9)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:39.879664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:40.018647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20199841e2764e499c24b7933d7878d9', 'request_id': 'req-00cfd6a4-9b38-425a-9d22-77740a40494a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:40.025012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20199841e2764e499c24b7933d7878d9', 'request_id': 'req-00cfd6a4-9b38-425a-9d22-77740a40494a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:40.103608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20199841e2764e499c24b7933d7878d9', 'request_id': 'req-00cfd6a4-9b38-425a-9d22-77740a40494a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:40.114617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] The token cache is being invalidate because project 20199841e2764e499c24b7933d7878d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:23:40.114904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:40.116546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00cfd6a4-9b38-425a-9d22-77740a40494a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:23:40.117590 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1110/2250] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:23:39 2022] DELETE /identity/v3/projects/20199841e2764e499c24b7933d7878d9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:23:45.116329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:23:45.117887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:45.181527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52b33-50e8-4ccc-8a5e-b30f9e9097ad admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:23:45.215819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:45.237593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:23:45.238187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:45.238468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:45.238746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:45.241080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:45.299600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:23:45.300952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:23:45.310995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1141/2251] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:23:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:23:50.111440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:23:52.322502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:23:52.323181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:23:52.323181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:23:52.341637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] MFA Rules not processed for user `b7c7538bc2bb4906932e73b56d71e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:23:52.342906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:23:52.350022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1111/2252] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:23:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:23:55.307112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=33 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:02.336274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:04.437329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:04.439067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:04.450219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12cf4c-dfd3-4a18-a78d-01075bcc5330 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:04.454415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:04.455154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:04.460921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:04.460921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:04.460921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:04.468319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:04.469779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:04.479016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1142/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:13.864502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:13.866101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:13.938387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b8a3bc-2c7c-48da-bf2a-66982ad22586 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:13.944278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:13.944984 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:13.945268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:13.945544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:13.947378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:14.006196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:14.007802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3cf3b6-2379-4f37-b944-32580f4018e6 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:14.018265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1112/2254] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:14.474555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:20.335383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:20.336953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:20.354874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a64fd-1c65-4d5a-a4b3-f3e0d1001c81 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:20.361356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:20.362133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:20.362476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:20.362825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:20.364706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:20.377554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:20.379167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:20.390995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1143/2255] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:24.013831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=56 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:25.167322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:25.167976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:25.167976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:25.185045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] MFA Rules not processed for user `c42165e400c247aba309d3c7a370f476`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:24:25.186355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:25.193278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1113/2256] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:24:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:24:25.728266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:25.729671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:25.741266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d7944-23f8-4a13-8266-daf33fa83bc8 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:25.744895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:25.745523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:25.745841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:25.746119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:25.748347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:25.757561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:25.759009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:25.767574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1144/2257] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:26.151301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:26.152826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:26.225963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec14ef-e4f3-4565-be42-26d5e01c357c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:26.231054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:26.232320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:26.232601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:26.232873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:26.234656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:26.246682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:26.248290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:26.258050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1114/2258] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:35.764027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=12 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:36.087787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:36.101734 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08fba22-7737-4a0c-ae58-a89c4082f62b service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:36.107499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:36.108142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:36.108445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:36.108750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:36.110613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:36.123116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:36.124774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:36.136284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1145/2259] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:36.253894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=35 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:24:40.147088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:40.159742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3107c3-954b-4999-bddb-22311639cff5 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:40.165244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:40.165926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:40.166206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:40.166480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:40.168219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:40.183073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:40.184898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:40.196929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1115/2260] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:45.197515 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:45.198941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:45.256553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86732c6-0306-4738-88c7-68caaac8f424 service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:45.260186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:45.260839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:45.261125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:45.261404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:45.263229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:45.321339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:45.322795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a3b3c9-a94c-49a7-8cfc-b5a658e6aea9 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:45.332130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1146/2261] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:46.782834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:24:46.792203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8165573-93a8-48f2-9539-bcae9751309d service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:24:46.795796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:24:46.796423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:46.796703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:46.796979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:46.798757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:46.881811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:24:46.883236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:24:46.892432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1116/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:24:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:24:54.331951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:24:54.332523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:24:54.332735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:24:54.351050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] MFA Rules not processed for user `8dd9bbd11fd74ed1963cc0ecc84d643b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:24:54.352318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:24:54.359646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1147/2263] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:24:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:24:56.888060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=34 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:04.345333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=57 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:11.914250 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:11.924293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0847ca63-7cd3-4bdf-8d27-3c96732099df service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:11.927991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:11.928630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:11.929411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:11.929411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:11.931012 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:11.999981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:12.002397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:12.013756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1117/2264] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:15.836490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:15.838638 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:15.854368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7534d3-7261-465c-9287-ecef623c59c7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:15.860126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:15.860773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:15.861054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:15.861327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:15.863216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:15.875340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:15.876815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:15.886795 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1148/2265] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:15.972223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:15.973884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:15.986951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df26cea-b4c7-4b91-a078-6d06e443d52c service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:15.991683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:15.992640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:15.992917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:15.993185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] PATH_INFO: `/v3/users/a7c271c1c0014af0bfc280e36135ce20` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:15.994405 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7c271c1c0014af0bfc280e36135ce20)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:15.996306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:16.215437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7c271c1c0014af0bfc280e36135ce20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.227893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7c271c1c0014af0bfc280e36135ce20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.301639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7c271c1c0014af0bfc280e36135ce20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.310333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7c271c1c0014af0bfc280e36135ce20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.311081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-03cca546-95cf-4a30-bcfb-c83613ab8c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7c271c1c0014af0bfc280e36135ce20'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.317278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1118/2266] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:25:15 2022] DELETE /identity/v3/users/a7c271c1c0014af0bfc280e36135ce20 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:16.623115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:16.637659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca209dd4-76b5-4085-a9df-9c806ddd0e90 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:16.700169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:16.701034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:16.701339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:16.701611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] PATH_INFO: `/v3/projects/d91120f45ad3454c94e1438788253cf3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:16.703103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d91120f45ad3454c94e1438788253cf3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:16.705014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:16.891085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd91120f45ad3454c94e1438788253cf3', 'request_id': 'req-79a6d5e3-9435-4402-b1bd-ead5e621472c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.897428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd91120f45ad3454c94e1438788253cf3', 'request_id': 'req-79a6d5e3-9435-4402-b1bd-ead5e621472c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.902904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd91120f45ad3454c94e1438788253cf3', 'request_id': 'req-79a6d5e3-9435-4402-b1bd-ead5e621472c'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.992493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] The token cache is being invalidate because project d91120f45ad3454c94e1438788253cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:25:16.992786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.993407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-79a6d5e3-9435-4402-b1bd-ead5e621472c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:16.995662 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1149/2267] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:25:16 2022] DELETE /identity/v3/projects/d91120f45ad3454c94e1438788253cf3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:17.000683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7852-8c7d-4862-a242-92339258629d None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.004171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7852-8c7d-4862-a242-92339258629d None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.004171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab7852-8c7d-4862-a242-92339258629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.018571 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-59ab7852-8c7d-4862-a242-92339258629d None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:17.019780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-59ab7852-8c7d-4862-a242-92339258629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:17.079306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1119/2268] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:17.086932 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.087222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.087505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.105998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:17.107202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:17.115088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1150/2269] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:17.119782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7852-8c7d-4862-a242-92339258629d None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.129276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab7852-8c7d-4862-a242-92339258629d None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.133822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.134466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.134775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.135054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.135774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:25:17.136081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.137672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.139248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:17.149831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1120/2270] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:25:17.154048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.163410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba55ba8-ec70-4e77-b9e4-763e3583c569 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.169996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.169996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.169996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.169996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.170498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.172392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.268822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1151/2271] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:25:17 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:17.273545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.284159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b2d5-8e20-4f14-a133-21f34f9af04c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.340287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.340976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.341257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.341533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.342253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.344233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.410428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1121/2272] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:25:17 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:17.414534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.425661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232481c-7846-4aff-9c41-691f1a2c34ae admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.430406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.431101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.431383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.432150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.432898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.434519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.444383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1152/2273] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:17.448917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.459035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4070d-560f-4251-bb99-59a747013599 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.463620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.464254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.464532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.464804 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.465519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.467126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e758111-bf61-4bbd-9d55-96564e4df36a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.476790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1122/2274] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:17.480751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.490736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2163c44-f414-4f48-b387-8e8be5e8bc44 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.496093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.497001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.497281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.497559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] PATH_INFO: `/v3/projects/99df6ab1afa8416eb4b92dc848368c7f/users/235aef51ea5042e8a25c8e5eeace3b37/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.512998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=99df6ab1afa8416eb4b92dc848368c7f, user_id=235aef51ea5042e8a25c8e5eeace3b37, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.515702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.587343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1153/2275] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:17 2022] PUT /identity/v3/projects/99df6ab1afa8416eb4b92dc848368c7f/users/235aef51ea5042e8a25c8e5eeace3b37/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:17.598120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.598414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.598697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.626183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] MFA Rules not processed for user `235aef51ea5042e8a25c8e5eeace3b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:17.627395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:17.691177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1123/2276] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:17.702595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:17.704484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:17.711091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:17.779682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c1c68-d3a1-4889-a93b-986eaf13bcdb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:17.785374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:17.786050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:17.786333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:17.786611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:17.795049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:17.796665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1536-b994-43ed-bece-770c857434e7 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:17.807127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1154/2277] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:18.018633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:18.080411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351479a-fb84-43ee-8b96-f4669083abc7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:18.084926 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:18.085814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:18.086100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:18.086380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] PATH_INFO: `/v3/users/235aef51ea5042e8a25c8e5eeace3b37` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:18.087567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=235aef51ea5042e8a25c8e5eeace3b37)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:18.090021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:18.092271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:18.349881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235aef51ea5042e8a25c8e5eeace3b37'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:18.362238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235aef51ea5042e8a25c8e5eeace3b37'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:18.433207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235aef51ea5042e8a25c8e5eeace3b37'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:18.440665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235aef51ea5042e8a25c8e5eeace3b37'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:18.441295 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235aef51ea5042e8a25c8e5eeace3b37'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:18.447199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1124/2278] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:25:18 2022] DELETE /identity/v3/users/235aef51ea5042e8a25c8e5eeace3b37 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:18.452197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:18.452687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:18.455075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:18.470197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:18.471406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:18.541649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1155/2279] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:18.551327 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:18.552733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:18.609487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358df3d-8880-428f-8b89-1450363a8bbd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:18.613188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:18.613864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:18.614149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:18.614423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:18.624379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:18.625974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc366a73-0cac-463c-9720-7aaad31ac662 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:18.635600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1125/2280] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:19.057367 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.058934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:19.070673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcf2d7-9e24-4c1b-921b-0d9bf4a36c1a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.075639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.076530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.077186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.077525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] PATH_INFO: `/v3/projects/99df6ab1afa8416eb4b92dc848368c7f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.078954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99df6ab1afa8416eb4b92dc848368c7f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.081851 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.176266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99df6ab1afa8416eb4b92dc848368c7f', 'request_id': 'req-3d030548-d0b3-4694-9527-9f8d3ed73166'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:19.183290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99df6ab1afa8416eb4b92dc848368c7f', 'request_id': 'req-3d030548-d0b3-4694-9527-9f8d3ed73166'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:19.191552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99df6ab1afa8416eb4b92dc848368c7f', 'request_id': 'req-3d030548-d0b3-4694-9527-9f8d3ed73166'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:19.261824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] The token cache is being invalidate because project 99df6ab1afa8416eb4b92dc848368c7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:25:19.262114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:19.262745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3d030548-d0b3-4694-9527-9f8d3ed73166 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:19.264647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1156/2281] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:25:19 2022] DELETE /identity/v3/projects/99df6ab1afa8416eb4b92dc848368c7f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:19.269921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.270706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.270897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.289070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:19.290436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:19.349782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1126/2282] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:19.357706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.358007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.358280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.376221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:19.377432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:19.385938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1157/2283] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:19.390157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.399935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff03d13-74aa-4829-816b-1b6556e60338 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.405150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.405835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.406122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.406427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.407163 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:25:19.407474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.409073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.420910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1127/2284] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:25:19.425209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.434637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f05fb-abae-4337-bf58-8fb7ab02a39c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.439386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.440028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.440309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.440614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.441299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.443253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.446552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:19.537481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1158/2285] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:25:19 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:19.541453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.552087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215851-6fa6-423f-9cfe-21f81cd0c628 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.561324 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:19.609605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.610233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.610563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.610802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.611514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.613682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.725741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1128/2286] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:25:19 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:19.730186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.741026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ecd6cc-bf34-4555-9893-276574bdd069 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.746872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.747534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.747824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.748086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.748811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.750441 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.761150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1159/2287] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:19.765560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.776432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7246-38f4-400b-b60f-3380e144b81b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.781177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.781868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.782146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.782419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.783146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.784714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea0fa0-3d2a-4d82-a4e4-1af1e3bf637a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.794981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1129/2288] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:19.799397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:19.813814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762d3e3-7327-40e4-abfb-530daf460a98 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:19.818499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:19.819376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.819702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.819976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] PATH_INFO: `/v3/projects/17f4dabc44954efab7d06a3483e12f63/users/328f064f4ebe49038f5c1740bd0377b5/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.835838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] RBAC: Authorizing `identity:create_grant(project_id=17f4dabc44954efab7d06a3483e12f63, user_id=328f064f4ebe49038f5c1740bd0377b5, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:19.838530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:19.938186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1160/2289] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:19 2022] PUT /identity/v3/projects/17f4dabc44954efab7d06a3483e12f63/users/328f064f4ebe49038f5c1740bd0377b5/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:19.948249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:19.948532 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:19.948865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:19.976920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] MFA Rules not processed for user `328f064f4ebe49038f5c1740bd0377b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:19.978732 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:20.045122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1130/2290] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:20.049670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.111892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a23d4-9697-426f-a1e8-6b9e19b6307f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.116503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.117154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.117428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.117700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.118420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.120934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.213290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1161/2291] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:25:20 2022] POST /identity/v3/projects => generated 387 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:20.217126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.229483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30409daa-4933-4b3f-9dfb-98a96b9ddb92 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.286900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.287561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.287837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.288108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.288795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.291325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.410454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1131/2292] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:25:20 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:20.414438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.425511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5c718-d41f-4438-8d1c-2b0100959418 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.430134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.430793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.431671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.431671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.432254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.433892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.444622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1162/2293] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:20.449380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.459699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bfa48-5f19-4b68-b513-bb23db58c380 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.464871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.465683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.465999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.466276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] PATH_INFO: `/v3/projects/f79a2ba847714c339f3400947a40348d/users/05945d324c18428b85a3a8be39436d04/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.469507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:20.481603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79a2ba847714c339f3400947a40348d, user_id=05945d324c18428b85a3a8be39436d04, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.484388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.542124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1132/2294] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:20 2022] PUT /identity/v3/projects/f79a2ba847714c339f3400947a40348d/users/05945d324c18428b85a3a8be39436d04/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:20.546377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.556611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb0e09-53b0-4e21-9210-82b4e4c7551f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.614676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.615354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.615636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.615910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.616623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.618281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d9c2c-ee72-4ea8-ae20-8e6b98a7bb70 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.628097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1163/2295] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:20.632237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.643134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f242acb-37ab-4430-b04c-1c8dfb051502 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.647788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.648657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.648951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.649216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] PATH_INFO: `/v3/projects/f79a2ba847714c339f3400947a40348d/users/05945d324c18428b85a3a8be39436d04/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.651793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79a2ba847714c339f3400947a40348d, user_id=05945d324c18428b85a3a8be39436d04, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.654461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.664680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1133/2296] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:20 2022] PUT /identity/v3/projects/f79a2ba847714c339f3400947a40348d/users/05945d324c18428b85a3a8be39436d04/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:20.675909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.676200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.676481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.703273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] MFA Rules not processed for user `05945d324c18428b85a3a8be39436d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:20.704492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:20.713318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:20.773561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1164/2297] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:20.784661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:20.786387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:20.843742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713be74-a559-45da-8124-f3e729c83cb3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:20.847508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:20.848144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:20.848427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:20.848703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:20.857997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:20.859422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a1c7d-ebbb-48a2-9e70-e2b8105cdfa6 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:20.868839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1134/2298] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:20.994711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:21.055628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2075c8-d594-4727-a876-dfff11b1d8df None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:21.060573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:21.061442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:21.061749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:21.062029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] PATH_INFO: `/v3/users/328f064f4ebe49038f5c1740bd0377b5` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:21.063208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328f064f4ebe49038f5c1740bd0377b5)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:21.065122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:21.253185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328f064f4ebe49038f5c1740bd0377b5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:21.267034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328f064f4ebe49038f5c1740bd0377b5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:21.381054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328f064f4ebe49038f5c1740bd0377b5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:21.381680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328f064f4ebe49038f5c1740bd0377b5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:21.389575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328f064f4ebe49038f5c1740bd0377b5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:21.395666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1165/2299] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:25:20 2022] DELETE /identity/v3/users/328f064f4ebe49038f5c1740bd0377b5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:21.400426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:21.400939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:21.401047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:21.419366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:21.420602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:21.479621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1135/2300] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:21.489396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:21.490850 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:21.521048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:21.550267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd28450-93f2-4d3f-9a07-f131ae76d035 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:21.553976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:21.554619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:21.554893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:21.555161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:21.565261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:21.566701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:21.576988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1166/2301] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:21.954584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:21.956031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:21.968583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902c539-143a-4ff2-8763-5a253aa48431 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:21.974456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:21.975334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:21.975619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:21.975898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] PATH_INFO: `/v3/projects/17f4dabc44954efab7d06a3483e12f63` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:21.977143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17f4dabc44954efab7d06a3483e12f63)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:21.980767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:22.084829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17f4dabc44954efab7d06a3483e12f63', 'request_id': 'req-fc334fbc-1a02-45d1-a231-b48ba2d055d3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.091618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17f4dabc44954efab7d06a3483e12f63', 'request_id': 'req-fc334fbc-1a02-45d1-a231-b48ba2d055d3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.152769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17f4dabc44954efab7d06a3483e12f63', 'request_id': 'req-fc334fbc-1a02-45d1-a231-b48ba2d055d3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.159803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:22.164355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] The token cache is being invalidate because project 17f4dabc44954efab7d06a3483e12f63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:25:22.164662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.165284 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.166865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1136/2302] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:25:21 2022] DELETE /identity/v3/projects/17f4dabc44954efab7d06a3483e12f63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:22.170860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:22.180776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b0d43-2ad6-40cd-a5c4-bf4a874f84a2 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:22.242352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:22.245210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:22.245210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:22.245210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] PATH_INFO: `/v3/users/05945d324c18428b85a3a8be39436d04` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:22.245210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05945d324c18428b85a3a8be39436d04)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:22.247347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:22.401502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05945d324c18428b85a3a8be39436d04'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.413907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05945d324c18428b85a3a8be39436d04'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.461108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05945d324c18428b85a3a8be39436d04'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.461837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05945d324c18428b85a3a8be39436d04'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.469977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-92abb7cd-9f1e-4fa6-bf13-b23eead71f32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05945d324c18428b85a3a8be39436d04'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:22.476166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1167/2303] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:25:22 2022] DELETE /identity/v3/users/05945d324c18428b85a3a8be39436d04 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:25:22.868836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:22.870871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:22.885253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc334fbc-1a02-45d1-a231-b48ba2d055d3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:22.947019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:22.947913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:22.948198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:22.948474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] PATH_INFO: `/v3/projects/f79a2ba847714c339f3400947a40348d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:22.949679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79a2ba847714c339f3400947a40348d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:22.951614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.061705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79a2ba847714c339f3400947a40348d', 'request_id': 'req-ead0609a-0373-4fa4-9b5b-32e8a00174c2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:23.067917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79a2ba847714c339f3400947a40348d', 'request_id': 'req-ead0609a-0373-4fa4-9b5b-32e8a00174c2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:23.164272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79a2ba847714c339f3400947a40348d', 'request_id': 'req-ead0609a-0373-4fa4-9b5b-32e8a00174c2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:23.175709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] The token cache is being invalidate because project f79a2ba847714c339f3400947a40348d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:25:23.176018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:23.176618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ead0609a-0373-4fa4-9b5b-32e8a00174c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:23.178199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1137/2304] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:25:22 2022] DELETE /identity/v3/projects/f79a2ba847714c339f3400947a40348d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:23.183538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.184034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.184131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.201568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:23.203067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:23.250521 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:23.268368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1168/2305] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:23.276677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.276965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.277242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.295893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:23.297096 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:23.305203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1138/2306] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:23.309456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.320353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4c263-2ad6-44c2-8ec9-30d6980a2fa0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.325173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.329346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.341411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1169/2307] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:25:23.345786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.356116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641e290-a574-44e4-8700-49e98ce5bb0b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.361504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.362188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.367962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.367962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.367962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.367962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.445901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1139/2308] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:25:23 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:23.450010 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.460170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00583ce1-f013-431d-a7cf-4569de56ff38 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.518309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.518977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.519263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.519541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.520272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.522236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.605348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1170/2309] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:25:23 2022] POST /identity/v3/users => generated 281 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:25:23.609954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.620775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95e439-9be2-40ed-ba42-479ccc0a1643 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.626076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.626745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.627054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.627330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.630576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.630576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.642521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1140/2310] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:23.646517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.657697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a7ae1-77e4-40fe-99f2-6452a7752938 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.662496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.663143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.663418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.663689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.664405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.666057 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d8dfd-1f54-408b-92bf-f5f90a34bd22 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.676620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1171/2311] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:23.681086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.691217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c500b5b-6e15-489c-8158-7375494873ce admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.695840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.696717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.697668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.697979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] PATH_INFO: `/v3/projects/7718d2f0c4244da1a6575d1afd644c98/users/a9dfc5874f574655aae6e86a2e338255/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.713447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7718d2f0c4244da1a6575d1afd644c98, user_id=a9dfc5874f574655aae6e86a2e338255, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:23.716138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:23.799267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1141/2312] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:23 2022] PUT /identity/v3/projects/7718d2f0c4244da1a6575d1afd644c98/users/a9dfc5874f574655aae6e86a2e338255/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:23.809678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.809988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:23.810265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:23.838655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] MFA Rules not processed for user `a9dfc5874f574655aae6e86a2e338255`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:23.839852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:23.904355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1172/2313] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:23.936720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:23.938426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:23.966401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:23.995340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c7a62-58e3-4799-90ec-8b10733f55a0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:23.999025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:23.999665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:23.999950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:24.000228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:24.008512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:24.010523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483af740-6c94-4b6e-bc66-5885fe8a0c6a service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:24.019520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1142/2314] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:24.033896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:24.082261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:24.100648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d22156-ceea-43b9-b9f0-719fd3124268 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:24.106001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:24.107092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:24.107713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:24.107996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] PATH_INFO: `/v3/users/a9dfc5874f574655aae6e86a2e338255` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:24.109236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9dfc5874f574655aae6e86a2e338255)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:24.111359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:24.503394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9dfc5874f574655aae6e86a2e338255'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:24.515498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9dfc5874f574655aae6e86a2e338255'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:24.638604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9dfc5874f574655aae6e86a2e338255'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:24.639214 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9dfc5874f574655aae6e86a2e338255'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:24.647079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9dfc5874f574655aae6e86a2e338255'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:24.654173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1173/2315] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:25:24 2022] DELETE /identity/v3/users/a9dfc5874f574655aae6e86a2e338255 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:24.658873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:24.660144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:24.660144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:24.677045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:24.678422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:24.742516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1143/2316] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:24.753007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:24.755419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:24.824101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3eec5-521a-48ef-8a01-25df4da3821e admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:24.828291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:24.828944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:24.829225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:24.829594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:24.840690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:24.842195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce657b-061d-468a-a4bd-37877f72aaaa service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:24.852778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1174/2317] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:25.320780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:25.322748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:25.336588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d9de9-eb89-46a3-a244-d1e54de30d7a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:25.345114 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:25.346030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.346307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.346581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] PATH_INFO: `/v3/projects/7718d2f0c4244da1a6575d1afd644c98` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.347753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7718d2f0c4244da1a6575d1afd644c98)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:25.349739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:25.463424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7718d2f0c4244da1a6575d1afd644c98', 'request_id': 'req-249668eb-c8be-42c9-b9de-f6e4a1b271a2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:25.470430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7718d2f0c4244da1a6575d1afd644c98', 'request_id': 'req-249668eb-c8be-42c9-b9de-f6e4a1b271a2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:25.541710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7718d2f0c4244da1a6575d1afd644c98', 'request_id': 'req-249668eb-c8be-42c9-b9de-f6e4a1b271a2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:25.553074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] The token cache is being invalidate because project 7718d2f0c4244da1a6575d1afd644c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:25:25.553367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:25.554064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-249668eb-c8be-42c9-b9de-f6e4a1b271a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:25:25.555641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1144/2318] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:25:25 2022] DELETE /identity/v3/projects/7718d2f0c4244da1a6575d1afd644c98 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:25:25.568873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.569351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.569351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.588395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:25.589618 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:25.653149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1175/2319] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:25.662409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.668748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.668748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.681057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:25.682783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:25.691207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1145/2320] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:25:25.695543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:25.702689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:25.706587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5906a-b281-4eba-aced-229c1bd06d42 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:25.711227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:25.711880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.712167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.712506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.713234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:25:25.713542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:25.715308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:25.728640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1176/2321] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:25:25.733257 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:25.742654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa93a3-7446-4e59-a996-50d18a855fc8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:25.747815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:25.748456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.748738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.749014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.749701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:25.751667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:25.860418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1146/2322] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:25:25 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:25:25.862841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:25.872631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb534b45-e110-4295-8ac3-c9ff111f0162 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:25.934253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:25.934567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:25.934848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:25.935117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:25.935838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:25.937783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:26.126507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1177/2323] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:25:25 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:25:26.130693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:26.141909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad67417-6be6-4ab3-8412-e4ba0cfd46cf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:26.146885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:26.147548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:26.147836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:26.148115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:26.148849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:26.150521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:26.161316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1147/2324] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:26.167568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:26.177370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a8451c-02cc-41c0-b408-cc1b29798e86 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:26.182797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:26.183455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:26.183733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:26.184007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:26.184732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:26.186415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259ce00-34aa-470f-8d36-ea3c42f94b06 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:26.196468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1178/2325] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:25:26.200542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:26.211229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7115d-f433-49ed-8732-f346125b2c6a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:26.216032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:26.216927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:26.217214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:26.217492 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] PATH_INFO: `/v3/projects/4d8e202a21864f0ba5c12a1ab755f878/users/dd4ef90a38c945b6aaf2d3a482ea5481/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:26.226778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:26.235207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8e202a21864f0ba5c12a1ab755f878, user_id=dd4ef90a38c945b6aaf2d3a482ea5481, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:26.238028 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:26.319782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1148/2326] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:25:26 2022] PUT /identity/v3/projects/4d8e202a21864f0ba5c12a1ab755f878/users/dd4ef90a38c945b6aaf2d3a482ea5481/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:25:26.330525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bd32-b3c9-4067-8728-34848c95af2a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:26.330808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bd32-b3c9-4067-8728-34848c95af2a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:26.331082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8bd32-b3c9-4067-8728-34848c95af2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:26.358166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ece8bd32-b3c9-4067-8728-34848c95af2a None None] MFA Rules not processed for user `dd4ef90a38c945b6aaf2d3a482ea5481`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:26.359378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ece8bd32-b3c9-4067-8728-34848c95af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:26.427652 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1179/2327] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:26 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:26.439254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:26.441091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:26.499726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b9ecd-e946-476e-9ffe-498c778dd573 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:26.503625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:26.504269 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:26.504552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:26.504827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:26.513363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:26.514832 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:26.523892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1149/2328] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:36.501588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:37.393262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:40.017172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:40.017821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:40.017821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:40.035462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] MFA Rules not processed for user `b7c7538bc2bb4906932e73b56d71e69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:25:40.036676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:40.095076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1180/2329] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:25:40.393293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:25:40.394664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:40.451914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84018a-37a1-45e0-b2c6-c3d56e28cafc service glance] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:25:40.455486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:25:40.456122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:25:40.456400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:25:40.456675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:25:40.458455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:25:40.468125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:25:40.469537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b995e68-4c9f-4abf-bdf6-30084335012a service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:25:40.477453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1150/2330] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:25:50.085928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=25 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:25:50.474122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=26 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:02.105991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:02.168464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd692e-cbd3-42da-baf5-4bc37dc68d84 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:02.173095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:02.173949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:02.174224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:02.174500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] PATH_INFO: `/v3/users/dd4ef90a38c945b6aaf2d3a482ea5481` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:02.175708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4ef90a38c945b6aaf2d3a482ea5481)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:02.177641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:02.333256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4ef90a38c945b6aaf2d3a482ea5481'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:02.345797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4ef90a38c945b6aaf2d3a482ea5481'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:02.426573 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4ef90a38c945b6aaf2d3a482ea5481'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:02.427109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4ef90a38c945b6aaf2d3a482ea5481'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:02.434999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4ef90a38c945b6aaf2d3a482ea5481'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:02.442099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1181/2331] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:26:02 2022] DELETE /identity/v3/users/dd4ef90a38c945b6aaf2d3a482ea5481 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:02.446582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:02.447084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:02.447221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:02.464333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:02.465520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:02.524108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1151/2332] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:02.533910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:02.535357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:02.602316 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e6b3c8-3e75-4b83-9523-d46b08918649 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:02.605939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:02.606583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:02.606946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:02.607140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:02.616639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:02.618162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397268e-5c3b-4802-88b6-9fadd0754620 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:02.629018 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1182/2333] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:03.011219 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.012649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:03.027002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fd90d-9f44-463e-8bc4-6f9bd17071b6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.032608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.033046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.033328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.033659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] PATH_INFO: `/v3/projects/4d8e202a21864f0ba5c12a1ab755f878` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.034954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8e202a21864f0ba5c12a1ab755f878)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.036765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.135786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8e202a21864f0ba5c12a1ab755f878', 'request_id': 'req-225a366c-4177-4472-bf1f-4c901ea38dbe'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:03.142546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8e202a21864f0ba5c12a1ab755f878', 'request_id': 'req-225a366c-4177-4472-bf1f-4c901ea38dbe'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:03.215854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8e202a21864f0ba5c12a1ab755f878', 'request_id': 'req-225a366c-4177-4472-bf1f-4c901ea38dbe'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:03.229370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] The token cache is being invalidate because project 4d8e202a21864f0ba5c12a1ab755f878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:26:03.229491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:03.230376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-225a366c-4177-4472-bf1f-4c901ea38dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:03.231826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1152/2334] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:26:03 2022] DELETE /identity/v3/projects/4d8e202a21864f0ba5c12a1ab755f878 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:03.237343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.237853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.238034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.259260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:03.259260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:03.274217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:03.316915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1183/2335] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:03.324875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.325159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.328148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.345359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:03.346511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:03.354628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1153/2336] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:26:03.359124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.369241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35a2c46-786f-499f-b4a3-0006baeba532 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.374422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.375694 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.375985 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.376258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.376978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:26:03.377308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.378940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.391380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1184/2337] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:26:03.395312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.404417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8026c2-345a-491b-9885-ff41be3cbb83 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.409129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.409818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.410100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.410377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.411066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.412956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.479236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1154/2338] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:03.483621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.494466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6803fe2-916c-49e3-926b-69cbf29c8a6c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.551493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.552032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.552315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.552593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.553285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.555631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.638381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1185/2339] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:26:03 2022] POST /identity/v3/users => generated 283 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:03.642611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.653242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4838-44c0-4b72-9b8b-f78c719970cb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.658519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.659178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.659455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.659728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.660453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.662120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.673556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1155/2340] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:03.677697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.687973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7d31d-6b92-494f-863e-b9bc214c4953 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.692726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.693375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.693653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.693957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.694673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.696253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78db127-1908-4a75-b31a-fda7f3576137 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.707969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1186/2341] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:03.712516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.722867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01799e-6137-4c16-b6b5-adc5daa413ff admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.727493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.728361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.728641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.728915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] PATH_INFO: `/v3/projects/9a4289d8284d41408bcbae5fd0ddf543/users/ace2a359a6654554a13c8a8d9e8a5c19/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.744000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a4289d8284d41408bcbae5fd0ddf543, user_id=ace2a359a6654554a13c8a8d9e8a5c19, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.746680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:03.804183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1156/2342] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:26:03 2022] PUT /identity/v3/projects/9a4289d8284d41408bcbae5fd0ddf543/users/ace2a359a6654554a13c8a8d9e8a5c19/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:03.815245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288dff-6558-420a-9ce6-1adf661b6536 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.815541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288dff-6558-420a-9ce6-1adf661b6536 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.815827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58288dff-6558-420a-9ce6-1adf661b6536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.843017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-58288dff-6558-420a-9ce6-1adf661b6536 None None] MFA Rules not processed for user `ace2a359a6654554a13c8a8d9e8a5c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:03.844241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-58288dff-6558-420a-9ce6-1adf661b6536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:03.911878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1187/2343] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:03.924058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:03.925919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:03.947847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:03.984149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf1ad5-0583-43cd-b052-1015f70ed23d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:03.987753 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:03.988386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:03.988689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:03.988986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:03.997652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:03.999568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:04.008224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1157/2344] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:13.908890 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:14.089294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=17 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:29.303809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:29.304236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:29.304236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:29.325255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:29.326773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:29.387056 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1188/2345] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:29.528720 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:29.530246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:29.600972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1c58c-a6ea-416f-af61-0b54ab7c0977 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:29.607017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:29.607915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:29.608195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:29.608475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:29.617191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:29.618897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:29.627407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1158/2346] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:26:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:26:37.243177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:37.244799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:37.321415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3e519-862a-4be0-b9fe-4539571a3f16 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:37.328533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:37.329217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:37.329498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:37.329824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:37.331584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:37.344468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:37.346153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452113e5-4aff-4dd3-a891-9e97aed1a4ae service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:37.356896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1189/2347] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:39.623960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=32 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:44.966380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:45.029797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc2055-4dad-475a-9dee-c8ec6a398949 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:45.034370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:45.035316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:45.035595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:45.035853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] PATH_INFO: `/v3/users/ace2a359a6654554a13c8a8d9e8a5c19` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:45.037111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2a359a6654554a13c8a8d9e8a5c19)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:45.039007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:45.239019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2a359a6654554a13c8a8d9e8a5c19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:45.251781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2a359a6654554a13c8a8d9e8a5c19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:45.317885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2a359a6654554a13c8a8d9e8a5c19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:45.326629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2a359a6654554a13c8a8d9e8a5c19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:45.327825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2a359a6654554a13c8a8d9e8a5c19'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:45.333319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1159/2348] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:26:44 2022] DELETE /identity/v3/users/ace2a359a6654554a13c8a8d9e8a5c19 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:45.337875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:45.338344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:45.338439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:45.356100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:45.357292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:45.415838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1190/2349] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:45.425637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:45.427093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:45.485322 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc8ac8-940a-4167-b2db-37081b01eb11 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:45.489161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:45.489849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:45.490136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:45.490415 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:45.500278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:45.501708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6f79b-c9fe-49a5-a244-272a0380f13a service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:45.511548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1160/2350] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:26:45.941823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:45.941823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:45.946447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a59a3-0956-4030-b4bb-6be68af566de None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:45.952220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:45.953419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:45.953873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:45.954201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] PATH_INFO: `/v3/projects/9a4289d8284d41408bcbae5fd0ddf543` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:45.955398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a4289d8284d41408bcbae5fd0ddf543)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:45.957837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.054378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:46.066536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a4289d8284d41408bcbae5fd0ddf543', 'request_id': 'req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:46.072676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a4289d8284d41408bcbae5fd0ddf543', 'request_id': 'req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:46.078321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a4289d8284d41408bcbae5fd0ddf543', 'request_id': 'req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:46.160920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] The token cache is being invalidate because project 9a4289d8284d41408bcbae5fd0ddf543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:26:46.161205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:46.161858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-b13cc03f-7af3-4628-b4de-cf410b9cdbf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:46.163417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1191/2351] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:26:45 2022] DELETE /identity/v3/projects/9a4289d8284d41408bcbae5fd0ddf543 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:46.168561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.169055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.169159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.186488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:46.187683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:46.205156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:46.247260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1161/2352] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:46.255349 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.255633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.255915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.275339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:46.276554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:46.284619 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1192/2353] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:46.288802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.298645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc12844-090b-401d-a1ef-1e6da8dd11ac None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.303005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.303652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.303935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.304246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.305011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:26:46.305319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.307015 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.318967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1162/2354] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:26:46.323747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.333338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b17fcb-a468-4719-8f1f-409d83729e9c None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.338550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.339187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.339471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.339737 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.340439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.342395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.437777 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1193/2355] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:26:46 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:46.441961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.452886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ac031-af63-40b2-8a78-1f6cbecdbd5f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.510707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.511288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.511570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.511846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.512537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.514508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.619796 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1163/2356] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:26:46 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:46.624015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.635165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb508d2-770d-4df4-9fed-bafc31dc5f5b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.639812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.640469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.640749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.641026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.641787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.643409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.654417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1194/2357] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:46.658537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.668730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602bc6a-3e6e-4adf-aa5e-9998798bf72a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.673627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.674321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.674603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.674875 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.675604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.677249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2c3d6-9274-484b-af4c-9ee0c88fe360 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.688256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1164/2358] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:46.692426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:46.703532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb2c04-b4ed-4810-9745-2454c8ed39bc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:46.708224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:46.709100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.709383 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.709661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] PATH_INFO: `/v3/projects/67afe00055794132af983a752b6d671d/users/598770ff798a4583a0e0ee913bcce2c6/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.724256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67afe00055794132af983a752b6d671d, user_id=598770ff798a4583a0e0ee913bcce2c6, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:46.726995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:46.906000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1195/2359] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:26:46 2022] PUT /identity/v3/projects/67afe00055794132af983a752b6d671d/users/598770ff798a4583a0e0ee913bcce2c6/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:46.917431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df73ef-acc3-4a85-987c-ccc41634dfe9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:46.917977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df73ef-acc3-4a85-987c-ccc41634dfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:46.918258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df73ef-acc3-4a85-987c-ccc41634dfe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:46.948967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-48df73ef-acc3-4a85-987c-ccc41634dfe9 None None] MFA Rules not processed for user `598770ff798a4583a0e0ee913bcce2c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:46.950692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-48df73ef-acc3-4a85-987c-ccc41634dfe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:47.023506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1165/2360] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:47.033678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:47.035456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:47.102293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79317b41-5015-429d-b01b-888c8ebb2917 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:47.106008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:47.109322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:47.109322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:47.109322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:47.115839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:47.117905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0c1e4-4ab0-42b2-85b2-0ac26c0ed4b2 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:47.126728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1196/2361] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:26:50.686279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:50.686814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:50.686814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:50.689774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1166/2362] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:26:50.694595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc549c-3593-4d4f-ae3a-23ac4dd301c6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:50.695097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc549c-3593-4d4f-ae3a-23ac4dd301c6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:50.695554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc549c-3593-4d4f-ae3a-23ac4dd301c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:50.723791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5adc549c-3593-4d4f-ae3a-23ac4dd301c6 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:50.725988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5adc549c-3593-4d4f-ae3a-23ac4dd301c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:50.788667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:50.806454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1197/2363] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:50.819778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:50.821780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:50.843884 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:50.882476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1580dc5-4b26-4249-b452-73f31e06ba3c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:50.886663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:50.887305 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:50.887642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:50.887919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:50.898243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:50.900319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7a21b3-32c4-4052-bfe8-c60d6a1b1f13 service glance] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:50.911161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1167/2364] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:51.171448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.171660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.171996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] PATH_INFO: `/` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.173412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1198/2365] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:26:51.178426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfb9-4157-43ac-9089-44960ad6fae7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.178713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfb9-4157-43ac-9089-44960ad6fae7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.179009 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfbfb9-4157-43ac-9089-44960ad6fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.201055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ebdfbfb9-4157-43ac-9089-44960ad6fae7 None None] MFA Rules not processed for user `8131b0b0725f461a97be0423b7d8bb16`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:51.202518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ebdfbfb9-4157-43ac-9089-44960ad6fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:51.257363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1168/2366] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:51.270580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:51.272303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:51.287884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfa171-517c-412c-b802-88d212cb0d74 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:51.291766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:51.292707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.292991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.293272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.301065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:51.302529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07ed77-226f-4876-90ce-5efb015f3e44 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:51.313550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1199/2367] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:51.399423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d59-d343-4f61-8320-14b50352de86 None None] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.399716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d59-d343-4f61-8320-14b50352de86 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.399999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c1d59-d343-4f61-8320-14b50352de86 None None] PATH_INFO: `/` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.401419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1169/2368] 10.222.0.65 () {54 vars in 921 bytes} [Fri Jun 24 15:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 24 15:26:51.407677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13574d-b934-4175-acce-0b18273e5f17 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.408067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13574d-b934-4175-acce-0b18273e5f17 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.414425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13574d-b934-4175-acce-0b18273e5f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.436022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8c13574d-b934-4175-acce-0b18273e5f17 None None] MFA Rules not processed for user `ecc895f2eaa245dc8f1b5d811a4c88e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:51.437486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8c13574d-b934-4175-acce-0b18273e5f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:51.448921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1200/2369] 10.222.0.65 () {58 vars in 1018 bytes} [Fri Jun 24 15:26:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:51.460606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c1d59-d343-4f61-8320-14b50352de86 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:51.471712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c1d59-d343-4f61-8320-14b50352de86 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:51.475520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:51.476157 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:51.476461 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:51.476719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:51.487684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:51.489105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:51.500633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1170/2370] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:53.936170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:53.936680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:53.936774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:53.956266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:53.957493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:54.014292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1201/2371] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:54.026901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:54.028390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:54.097610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89904117-6735-4095-be01-4a9ce00dd77c service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:54.103285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:54.103934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:54.111736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:54.111736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:54.112680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:54.114298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461bd60-9a04-4cac-9c9b-5f2f4dc46d17 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:54.122490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1171/2372] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:26:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:26:54.313679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:54.435233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a547115-dcc6-4d3a-8683-5dd08a44b02f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:54.439830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:54.440692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:54.440975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:54.441299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] PATH_INFO: `/v3/users/598770ff798a4583a0e0ee913bcce2c6` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:54.442538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=598770ff798a4583a0e0ee913bcce2c6)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:54.444491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:54.647110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '598770ff798a4583a0e0ee913bcce2c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:54.659642 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '598770ff798a4583a0e0ee913bcce2c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:54.728984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '598770ff798a4583a0e0ee913bcce2c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:54.729604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '598770ff798a4583a0e0ee913bcce2c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:54.734552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:54.737708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '598770ff798a4583a0e0ee913bcce2c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:54.745004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1202/2373] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:26:54 2022] DELETE /identity/v3/users/598770ff798a4583a0e0ee913bcce2c6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:54.749509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:54.749841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:54.750118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:54.768830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:54.770063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:54.818802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:54.840712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1172/2374] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:54.851297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:54.852928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:54.937805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda43ee-8ec0-414f-89dc-60b5e5f7d938 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:54.941385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:54.942065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:54.942346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:54.942623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:54.953771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:54.955239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc9141-9183-4fa0-af99-94d5cf82b52a service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:54.968822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1203/2375] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:26:55.418643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:55.420685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:55.442209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b8562-f6ce-467c-bac9-b7ec0d2539cc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:55.448097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:55.448977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:55.449249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:55.449519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] PATH_INFO: `/v3/projects/67afe00055794132af983a752b6d671d` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:55.455359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=67afe00055794132af983a752b6d671d)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:55.457337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:55.617274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67afe00055794132af983a752b6d671d', 'request_id': 'req-42098451-4782-42e0-abc5-defba65fec4c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:55.625441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67afe00055794132af983a752b6d671d', 'request_id': 'req-42098451-4782-42e0-abc5-defba65fec4c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:55.774736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67afe00055794132af983a752b6d671d', 'request_id': 'req-42098451-4782-42e0-abc5-defba65fec4c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:55.790095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] The token cache is being invalidate because project 67afe00055794132af983a752b6d671d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:26:55.790658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:55.791393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42098451-4782-42e0-abc5-defba65fec4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:26:55.793292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1173/2376] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:26:55 2022] DELETE /identity/v3/projects/67afe00055794132af983a752b6d671d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:26:55.799169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:55.799513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:55.800368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:55.838941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:55.840953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:55.913212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1204/2377] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:55.917245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:55.917709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:55.920013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:55.940965 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:55.942553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:55.952186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1174/2378] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:55.956497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:55.967175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c8b897-7f2c-44f5-9fe8-64b24d9effc9 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:55.971766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:55.972411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:55.972687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:55.972955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:55.973731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:26:55.974042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:55.975614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:55.987969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1205/2379] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:26:55.992724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.005972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e7ad7-5fe8-4bba-93fd-768f8a7576a5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.010899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.011501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.011782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.012102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.012758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.014725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.188339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1175/2380] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:26:55 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:56.193069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.204847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089823fd-18ce-4957-9184-fb3de93f6fda admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.280047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.280844 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.281215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.281602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.282428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.284473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.373218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1206/2381] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:26:56 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:26:56.377097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.388207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a2bc-8fff-44c1-a400-a1f73566100d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.392887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.393573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.393890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.394166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.394896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.396487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.407982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1176/2382] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:56.412375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.423899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c421fe6-cb0c-4a65-b764-0278ec13ad61 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.428861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.429540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.429846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.430124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.430907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.432520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f88a6-8989-40ba-b320-f0da42a2eed4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.447845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1207/2383] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:26:56.448634 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.459480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbd2f2-0e7b-4f21-a4a8-2024b78d0e8b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.464646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.465530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.465956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.466237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] PATH_INFO: `/v3/projects/22cc2033fe35466ea543f22b88eec531/users/cc711907b1ff466980be11077bbcec22/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.482472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=22cc2033fe35466ea543f22b88eec531, user_id=cc711907b1ff466980be11077bbcec22, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.485166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.633088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1177/2384] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:26:56 2022] PUT /identity/v3/projects/22cc2033fe35466ea543f22b88eec531/users/cc711907b1ff466980be11077bbcec22/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:26:56.638998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c94-25b9-4029-820d-adaa8a3f705c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.639289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c94-25b9-4029-820d-adaa8a3f705c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.639686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d9c94-25b9-4029-820d-adaa8a3f705c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.650394 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:26:56.676936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5f1d9c94-25b9-4029-820d-adaa8a3f705c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:26:56.679817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5f1d9c94-25b9-4029-820d-adaa8a3f705c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:56.760159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1208/2385] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:26:56.771980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:26:56.774037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:26:56.862487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f47a12-096d-440d-b294-b33adfe742bc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:26:56.868069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:26:56.875468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:26:56.875468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:26:56.875468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:26:56.891459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:26:56.893262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:26:56.905372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1178/2386] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:03.985319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:03.985867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:03.985867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.015207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] MFA Rules not processed for user `cc711907b1ff466980be11077bbcec22`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:04.016549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:04.104083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1209/2387] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:04.108706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.119356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e457-00c9-4df1-9de8-677ac8719290 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.124075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.126352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.126352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.126352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.126352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.127931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.132441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:04.229920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1179/2388] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:27:04 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:27:04.230706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.246342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8258c6a-71e5-4fa2-aa16-378d6bf1fe44 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.314617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.315363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.315680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.316007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.316665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.318742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.417899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1210/2389] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:27:04 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:04.418789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.430177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fdb1c-232d-4424-ae14-6fa26cc8dc45 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.436053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.436789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.437072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.437336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.438124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.439700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.451902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1180/2390] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:04.456135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.466455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcda492-8fd5-48b3-9621-a1f420e8370f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.471200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.474161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.474161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.474161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] PATH_INFO: `/v3/projects/f44c7266695c4e63b42fd27f34c2141c/users/b94413e947364811b4f66e4eed7867a3/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.488856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44c7266695c4e63b42fd27f34c2141c, user_id=b94413e947364811b4f66e4eed7867a3, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.491549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.579329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:04.585085 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1211/2391] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:04 2022] PUT /identity/v3/projects/f44c7266695c4e63b42fd27f34c2141c/users/b94413e947364811b4f66e4eed7867a3/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:04.589177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.599412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbd9c7-a3f5-4199-9a86-1493b8ba9d6a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.657840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.658523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.658810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.659090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.659848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.661452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fab2c-7c13-4066-8cbb-677cfda7f022 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.671672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1181/2392] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:04.675828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:04.686630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af22706-6f78-41ce-aa40-4ff88eacfd58 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:04.691896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:04.692769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:04.693051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:04.693327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] PATH_INFO: `/v3/projects/f44c7266695c4e63b42fd27f34c2141c/users/b94413e947364811b4f66e4eed7867a3/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:04.695324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44c7266695c4e63b42fd27f34c2141c, user_id=b94413e947364811b4f66e4eed7867a3, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:04.698657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:04.709512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1212/2393] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:04 2022] PUT /identity/v3/projects/f44c7266695c4e63b42fd27f34c2141c/users/b94413e947364811b4f66e4eed7867a3/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:10.706318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a8bb-f062-408b-b8cb-2ea4a6b89ada None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:10.706848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a8bb-f062-408b-b8cb-2ea4a6b89ada None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:10.706848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69a8bb-f062-408b-b8cb-2ea4a6b89ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:10.739241 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-ef69a8bb-f062-408b-b8cb-2ea4a6b89ada None None] MFA Rules not processed for user `b94413e947364811b4f66e4eed7867a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:10.740777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ef69a8bb-f062-408b-b8cb-2ea4a6b89ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:10.885053 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1182/2394] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:10.898475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:10.901097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:11.049763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36dad54-d689-4d6a-a540-9fe01ff8654d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:11.054784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:11.055723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:11.056008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:11.056323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:11.125173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:11.127067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:11.139145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1213/2395] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:11.402839 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5577f-3f5a-4e16-ade5-b401a1c1103a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:11.403253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5577f-3f5a-4e16-ade5-b401a1c1103a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:11.403569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d5577f-3f5a-4e16-ade5-b401a1c1103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:11.428715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-e9d5577f-3f5a-4e16-ade5-b401a1c1103a None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:11.429988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e9d5577f-3f5a-4e16-ade5-b401a1c1103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:11.505088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1183/2396] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:11.518288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:11.519743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:11.624308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd43e8-37db-4599-af8f-cf8951109532 service glance] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:11.632380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:11.633055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:11.633338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:11.633614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:11.654989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:11.656893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:11.669608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1214/2397] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 15:27:15.894432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13132-41f5-49ec-a749-bcfceae4f38b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:15.895404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13132-41f5-49ec-a749-bcfceae4f38b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:15.895840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13132-41f5-49ec-a749-bcfceae4f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:15.924047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:15.956191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-32e13132-41f5-49ec-a749-bcfceae4f38b None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:15.957506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-32e13132-41f5-49ec-a749-bcfceae4f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:15.985088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1184/2398] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:27:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:15.985196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:15.999022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4759b1-f017-407e-88b0-b14b81aada2f service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:16.032141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:16.032814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:16.033099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:16.033377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:16.057633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:16.059742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:16.090672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1215/2399] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:27:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 15:27:23.418158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980a3d2-e778-4dc6-98f8-13fc01153d89 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:23.418684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980a3d2-e778-4dc6-98f8-13fc01153d89 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:23.418780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980a3d2-e778-4dc6-98f8-13fc01153d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:23.438999 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0980a3d2-e778-4dc6-98f8-13fc01153d89 None None] MFA Rules not processed for user `cc711907b1ff466980be11077bbcec22`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:23.440286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0980a3d2-e778-4dc6-98f8-13fc01153d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:23.447335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1185/2400] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:26.080972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:26.812481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:26.885709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f12afab-e619-454e-b39c-c1e9e23ce2f6 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:26.889807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:26.890468 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:26.890748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:26.891024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:26.895366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:26.976017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:26.977535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:26.989310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1216/2401] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:27.090834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:27.091862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:27.092213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:27.123911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:27.125552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:27.135089 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1186/2402] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:27:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:27:27.151126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:27.172648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5234ee8-1e51-4bf4-9ab0-642c8a84450e service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:27.178729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:27.179737 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:27.180011 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:27.180283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:27.189970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:27.191630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:27.201835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1217/2403] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:27:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:27:31.886011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:31.887489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:31.902639 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8f43d-8e57-41c3-bf10-1179b15bbc70 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:31.910788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:31.910788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:31.910788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:31.910788 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] PATH_INFO: `/v3/users/8dd9bbd11fd74ed1963cc0ecc84d643b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:31.911174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd9bbd11fd74ed1963cc0ecc84d643b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:31.912258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:32.105264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd9bbd11fd74ed1963cc0ecc84d643b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.123031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd9bbd11fd74ed1963cc0ecc84d643b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.203216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd9bbd11fd74ed1963cc0ecc84d643b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.218486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd9bbd11fd74ed1963cc0ecc84d643b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.222838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ef899a30-ab3b-499e-9ebf-41ea017eea82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd9bbd11fd74ed1963cc0ecc84d643b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.231144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1187/2404] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:27:31 2022] DELETE /identity/v3/users/8dd9bbd11fd74ed1963cc0ecc84d643b => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:32.507891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:32.521648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069c25f4-f70b-4921-afe3-9b9934c78363 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:32.594263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:32.595232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:32.595598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:32.596069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] PATH_INFO: `/v3/projects/1e2b52f8f284478d96c34a613dbec8eb` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:32.597283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2b52f8f284478d96c34a613dbec8eb)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:32.599326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:32.709239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:32.717211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2b52f8f284478d96c34a613dbec8eb', 'request_id': 'req-f78b7017-c214-44e9-84b1-722ad738b05d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.723961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2b52f8f284478d96c34a613dbec8eb', 'request_id': 'req-f78b7017-c214-44e9-84b1-722ad738b05d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.730818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2b52f8f284478d96c34a613dbec8eb', 'request_id': 'req-f78b7017-c214-44e9-84b1-722ad738b05d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.804621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] The token cache is being invalidate because project 1e2b52f8f284478d96c34a613dbec8eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:27:32.811410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.811410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f78b7017-c214-44e9-84b1-722ad738b05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:32.811410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1218/2405] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:27:32 2022] DELETE /identity/v3/projects/1e2b52f8f284478d96c34a613dbec8eb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:32.813176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:32.813464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:32.813775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:32.850238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:32.852068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:32.936109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1188/2406] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:32.944276 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:32.944551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:32.944834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:32.965498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:32.966757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:32.975776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1219/2407] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:27:32.979822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:32.990378 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9a2be-ac13-4f46-9e1a-cd6079aeee65 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:32.996127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:32.996988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:32.997457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:32.997885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:32.998654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:27:32.998953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.000688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.014801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1189/2408] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:27:33.019300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:33.037218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667213ec-ef00-4357-a0c5-1c2f04c6d6a6 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:33.042390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:33.043181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.043534 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.043882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.044684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.046715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.217116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1220/2409] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:27:33 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:27:33.220704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:33.231475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf606-b256-46a1-8252-34c5fe60ac14 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:33.311034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:33.330797 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:33.331632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.331986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.332397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.333202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.335666 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.683787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1190/2410] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:27:33 2022] POST /identity/v3/users => generated 287 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:33.687710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:33.699570 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec542ac-8563-47ad-974f-a3bcf4a604d4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:33.704628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:33.705312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.705594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.705909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.706650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.708388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.721067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1221/2411] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:33.725141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:33.736803 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68979e71-f7e9-4a00-85f3-581b32a7a6a6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:33.741610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:33.742307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.742592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.742863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.743625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.745255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50037762-e387-4f7c-8f53-93c859cbc232 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.757155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1191/2412] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:27:33.762216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:33.772744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaef26-03d1-4f32-a5a5-5a184e6dd720 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:33.778590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:33.779477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.779754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.780025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] PATH_INFO: `/v3/projects/30d3ac0d2ec840ccb86a976063be4bf8/users/9ab27d803ab147b69f55b49e72446761/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.798201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d3ac0d2ec840ccb86a976063be4bf8, user_id=9ab27d803ab147b69f55b49e72446761, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:33.800996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:33.877937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1222/2413] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:33 2022] PUT /identity/v3/projects/30d3ac0d2ec840ccb86a976063be4bf8/users/9ab27d803ab147b69f55b49e72446761/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:33.891820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:33.892112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:33.892394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:33.925302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] MFA Rules not processed for user `9ab27d803ab147b69f55b49e72446761`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:33.926963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:34.009539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1192/2414] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:34.080426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:34.082301 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:34.162215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d9195-b4d3-42cd-baf8-760088fbccd7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:34.168687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:34.176579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:34.176579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:34.176579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:34.179194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:34.181372 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33557ca-3fc7-4601-b8d2-850adcee1856 service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:34.191453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1223/2415] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:38.509403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:38.579182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05f8d0-0ac7-4821-b5a4-6a8aa71c0f3a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:38.586093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:38.586973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:38.595186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:38.595186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] PATH_INFO: `/v3/users/9ab27d803ab147b69f55b49e72446761` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:38.595186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab27d803ab147b69f55b49e72446761)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:38.595186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:39.497431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab27d803ab147b69f55b49e72446761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:39.503191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:39.511604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab27d803ab147b69f55b49e72446761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:39.617503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab27d803ab147b69f55b49e72446761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:39.626500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab27d803ab147b69f55b49e72446761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:39.627779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab27d803ab147b69f55b49e72446761'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:39.634682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1193/2416] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:27:38 2022] DELETE /identity/v3/users/9ab27d803ab147b69f55b49e72446761 => generated 0 bytes in 1126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:39.640104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:39.640651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:39.640651 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:39.666979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:39.668736 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:39.718055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:39.733437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1224/2417] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:39.743105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:39.744503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:39.802531 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc6e77-84e3-4b23-bc3a-58d7cece4678 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:39.806168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:39.806805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:39.807081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:39.807408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:39.817107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:39.818946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2654d7-e534-4529-9a15-4aed2c796b20 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:39.828288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1194/2418] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:27:40.400972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:40.400972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:40.411105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f3abcd-1b82-4f03-b9b8-453b5e4df806 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:40.416594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:40.418034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:40.418496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:40.420097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] PATH_INFO: `/v3/projects/30d3ac0d2ec840ccb86a976063be4bf8` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:40.421393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d3ac0d2ec840ccb86a976063be4bf8)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:40.423356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:40.556613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d3ac0d2ec840ccb86a976063be4bf8', 'request_id': 'req-73022179-15a6-4d62-b20e-c96c9bd02ee7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:40.563692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d3ac0d2ec840ccb86a976063be4bf8', 'request_id': 'req-73022179-15a6-4d62-b20e-c96c9bd02ee7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:40.571330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d3ac0d2ec840ccb86a976063be4bf8', 'request_id': 'req-73022179-15a6-4d62-b20e-c96c9bd02ee7'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:40.689179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] The token cache is being invalidate because project 30d3ac0d2ec840ccb86a976063be4bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:27:40.689846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:40.690235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-73022179-15a6-4d62-b20e-c96c9bd02ee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:27:40.691789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1225/2419] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:27:40 2022] DELETE /identity/v3/projects/30d3ac0d2ec840ccb86a976063be4bf8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:40.696860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:40.697466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:40.697466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:40.736762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:40.738040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:40.812467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1195/2420] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:40.820491 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:40.820874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:40.821164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:40.840670 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:40.841966 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:40.853125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1226/2421] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:40.856264 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:40.865555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2146338-d6ab-48a0-8a39-27c20f4818f9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:40.870361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:40.871123 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:40.871321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:40.871635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:40.872319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:27:40.872630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:40.875292 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:40.887200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1196/2422] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:27:40.891566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:40.901067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f203c-94ed-445d-84e9-a50dee50c8f0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:40.906602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:40.907249 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:40.907526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:40.907825 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:40.908525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:40.910590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.027598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1227/2423] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:27:40 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:41.032178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.042888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ba0a8-ab8c-4a33-bc71-e164a21534ca admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.104543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.105740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.111757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.111757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.111757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.111757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.115800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:41.232279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1197/2424] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:27:41 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:41.236355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.247357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abe903-1a5f-4fd6-84a6-4dffe9736203 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.251953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.252650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.252935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.258260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.258260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.258260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.266568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1228/2425] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:41.270661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.280868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44646c3-154e-4145-973e-28078104b6a8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.286377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.287546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.288039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.288524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.289892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.293455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873857b8-aeec-4fa0-92ff-dd1e693aed61 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.309454 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1198/2426] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:41.311172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.321427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92b3b-10d3-4aa7-8671-c3afc0092166 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.328687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.329744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.330144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.330419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] PATH_INFO: `/v3/projects/772600ff08d84a03a3fe1a74e5a17f74/users/41145d962fea4f3fa6d594b7d64e65ce/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.351054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=772600ff08d84a03a3fe1a74e5a17f74, user_id=41145d962fea4f3fa6d594b7d64e65ce, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.353775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.438366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1229/2427] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:41 2022] PUT /identity/v3/projects/772600ff08d84a03a3fe1a74e5a17f74/users/41145d962fea4f3fa6d594b7d64e65ce/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:27:41.449216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766975d2-f392-4258-9a75-736993b089a9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.449502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766975d2-f392-4258-9a75-736993b089a9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.449833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766975d2-f392-4258-9a75-736993b089a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.475456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-766975d2-f392-4258-9a75-736993b089a9 None None] MFA Rules not processed for user `41145d962fea4f3fa6d594b7d64e65ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:41.476651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-766975d2-f392-4258-9a75-736993b089a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:41.541636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1199/2428] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:41.546872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.607928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65755eb-74ad-4a19-98fb-30bdb232a67d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.613330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.614079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.614295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.614565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.615243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.617137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.630160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:41.698974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1230/2429] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:27:41 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:41.700396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766975d2-f392-4258-9a75-736993b089a9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.710995 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766975d2-f392-4258-9a75-736993b089a9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.768398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.769065 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.769352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.769631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.771502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.772485 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.894897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1200/2430] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:27:41 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:27:41.899189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.910323 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdef6cf-2832-4777-9a1f-cd7d0d23a8eb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.915032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.915808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.916162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.916456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.917192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.918847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:41.929695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1231/2431] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:41.933882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:41.943955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3a699c-6fb2-4bbd-83a7-0d974aaeb4d7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:41.949371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:41.950225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:41.950509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:41.950786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] PATH_INFO: `/v3/projects/afe512be7bb54d509c0029e803fa14a2/users/4349cd410c4d4d138ed711bc2268d69c/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:41.966705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe512be7bb54d509c0029e803fa14a2, user_id=4349cd410c4d4d138ed711bc2268d69c, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:41.969331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:42.055776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1201/2432] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:41 2022] PUT /identity/v3/projects/afe512be7bb54d509c0029e803fa14a2/users/4349cd410c4d4d138ed711bc2268d69c/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:42.059905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:42.069952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489d50b6-b2bf-4e23-afda-5344cdbf4086 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:42.125335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:42.126030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:42.126315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:42.126591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:42.127312 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:42.128901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b9046-09c5-4d79-b4c8-882917de69e6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:42.139145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1232/2433] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:27:42.143234 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:42.153899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ba8ed9-0aeb-4efc-84e2-5cec68cc5a9d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:42.158474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:42.159334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:42.159613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:42.159885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] PATH_INFO: `/v3/projects/afe512be7bb54d509c0029e803fa14a2/users/4349cd410c4d4d138ed711bc2268d69c/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:42.161899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe512be7bb54d509c0029e803fa14a2, user_id=4349cd410c4d4d138ed711bc2268d69c, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:42.164521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:42.174778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1202/2434] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:27:42 2022] PUT /identity/v3/projects/afe512be7bb54d509c0029e803fa14a2/users/4349cd410c4d4d138ed711bc2268d69c/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:27:42.186455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:42.186755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:42.187037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:42.216335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] MFA Rules not processed for user `4349cd410c4d4d138ed711bc2268d69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:27:42.217479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:42.289435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1233/2435] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:27:42.301159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:42.302980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:42.328917 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:42.363168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465aa1b2-7c2b-4a50-a430-8c0b6540b7dc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:42.367727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:42.368377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:42.368662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:42.368938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:42.426445 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:42.427973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:42.437356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1203/2436] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:45.719689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:45.721327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:45.733819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ca5e1-71e0-44e5-9b65-053e8f1e7618 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:45.737942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:45.738633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:45.738918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:45.739187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:45.751820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:45.753275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:45.764049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1234/2437] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:52.432740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=39 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:55.759783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:INSERT=1,keystone:SELECT=76 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:27:57.724500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:57.726024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:57.782391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5556115-791f-4b15-9297-70c5e3f6291a service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:57.785943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:57.786545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:57.786821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:57.787091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:57.788828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:57.850403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:57.851835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:57.862143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1204/2438] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:27:59.435631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:27:59.435631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:59.446866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4b2355-4329-49c1-a619-e00c68f87ea2 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:27:59.451531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:27:59.452191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:27:59.452503 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:27:59.452790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:27:59.454641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:27:59.520930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:27:59.522411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe06c7-7c54-4758-a371-5041a182a0c1 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:27:59.534134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1235/2439] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:01.926377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:01.940745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087d47-3403-4de8-8f4d-a8b218761339 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:01.945474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:01.946843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:01.947130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:01.947407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] PATH_INFO: `/v3/users/41145d962fea4f3fa6d594b7d64e65ce` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:01.948886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41145d962fea4f3fa6d594b7d64e65ce)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:01.950831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:02.212882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41145d962fea4f3fa6d594b7d64e65ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:02.242202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41145d962fea4f3fa6d594b7d64e65ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:02.323407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41145d962fea4f3fa6d594b7d64e65ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:02.332411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41145d962fea4f3fa6d594b7d64e65ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:02.333304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41145d962fea4f3fa6d594b7d64e65ce'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:02.340617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1205/2440] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:01 2022] DELETE /identity/v3/users/41145d962fea4f3fa6d594b7d64e65ce => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:02.345121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:02.345631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:02.345781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:02.363895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:02.365170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:02.442525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1236/2441] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:02.453330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:02.455063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:02.493164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:02.532274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6189-2186-4db6-81f1-59f9e8894de8 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:02.536083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:02.536802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:02.537149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:02.537494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:02.549971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:02.551637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:02.567870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1206/2442] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:03.162265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:03.169467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:03.192300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6fab-a15a-4635-86c9-66ab4c1c9839 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:03.219359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:03.220865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:03.221246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:03.221620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] PATH_INFO: `/v3/projects/772600ff08d84a03a3fe1a74e5a17f74` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:03.223053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=772600ff08d84a03a3fe1a74e5a17f74)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:03.225612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:03.389305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772600ff08d84a03a3fe1a74e5a17f74', 'request_id': 'req-7ca681d9-8b10-44d9-8ee9-7e991f928e96'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.397558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772600ff08d84a03a3fe1a74e5a17f74', 'request_id': 'req-7ca681d9-8b10-44d9-8ee9-7e991f928e96'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.404171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772600ff08d84a03a3fe1a74e5a17f74', 'request_id': 'req-7ca681d9-8b10-44d9-8ee9-7e991f928e96'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.509659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] The token cache is being invalidate because project 772600ff08d84a03a3fe1a74e5a17f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:03.510137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.510855 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.512888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1237/2443] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:03 2022] DELETE /identity/v3/projects/772600ff08d84a03a3fe1a74e5a17f74 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:03.517712 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:03.529579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db84ba-8fd8-4f43-b2e0-3e35d76d3f1e service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:03.591698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:03.592568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:03.592851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:03.593156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] PATH_INFO: `/v3/users/4349cd410c4d4d138ed711bc2268d69c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:03.594357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4349cd410c4d4d138ed711bc2268d69c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:03.596276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:03.854573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4349cd410c4d4d138ed711bc2268d69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.868335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:03.871127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:03.872559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4349cd410c4d4d138ed711bc2268d69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.894716 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:03.947280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca681d9-8b10-44d9-8ee9-7e991f928e96 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:03.953208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:03.953882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:03.954165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:03.954434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:03.956282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:03.961362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4349cd410c4d4d138ed711bc2268d69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.969937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4349cd410c4d4d138ed711bc2268d69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.970096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:03.970705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4349cd410c4d4d138ed711bc2268d69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:03.975240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:03.978132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1207/2444] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:03 2022] DELETE /identity/v3/users/4349cd410c4d4d138ed711bc2268d69c => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:03.987588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1238/2445] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:04.083723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:04.085314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:04.144119 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:04.162513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717282a-7c36-449a-b892-7b9d82d35c4b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:04.167109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:04.167979 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:04.168262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:04.168538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] PATH_INFO: `/v3/users/b7c7538bc2bb4906932e73b56d71e69c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:04.169794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c7538bc2bb4906932e73b56d71e69c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:04.172377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:04.384752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c7538bc2bb4906932e73b56d71e69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.397385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c7538bc2bb4906932e73b56d71e69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.450354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:04.450354 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:04.471388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c7538bc2bb4906932e73b56d71e69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.485332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c05724-d1a6-43eb-9bcf-ed810647af03 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:04.487170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:04.488408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:04.489046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:04.489747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] PATH_INFO: `/v3/projects/afe512be7bb54d509c0029e803fa14a2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:04.492079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c7538bc2bb4906932e73b56d71e69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.495050 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe512be7bb54d509c0029e803fa14a2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:04.495351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c7538bc2bb4906932e73b56d71e69c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.498540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:04.507848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1208/2446] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:04 2022] DELETE /identity/v3/users/b7c7538bc2bb4906932e73b56d71e69c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:04.788433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe512be7bb54d509c0029e803fa14a2', 'request_id': 'req-50d8df30-cd6c-44ef-8185-5d36494c2b68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.788433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe512be7bb54d509c0029e803fa14a2', 'request_id': 'req-50d8df30-cd6c-44ef-8185-5d36494c2b68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.788433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe512be7bb54d509c0029e803fa14a2', 'request_id': 'req-50d8df30-cd6c-44ef-8185-5d36494c2b68'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:04.950553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:04.952038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.000575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] The token cache is being invalidate because project afe512be7bb54d509c0029e803fa14a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:05.001411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.002341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-50d8df30-cd6c-44ef-8185-5d36494c2b68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.005025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1239/2447] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:04 2022] DELETE /identity/v3/projects/afe512be7bb54d509c0029e803fa14a2 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:05.009904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84dfa7-2918-4683-b9b8-dedda3aee676 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.011138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84dfa7-2918-4683-b9b8-dedda3aee676 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.011602 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84dfa7-2918-4683-b9b8-dedda3aee676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.038755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ea84dfa7-2918-4683-b9b8-dedda3aee676 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:05.040277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ea84dfa7-2918-4683-b9b8-dedda3aee676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.071560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0434399-db84-4dde-964a-a8cecbdb8457 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.132527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1240/2448] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:05.140725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.141028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.141317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.161846 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:05.162940 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.163094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.163822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.164116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.164381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] PATH_INFO: `/v3/projects/8e5fdee9d9f042ba9dde6c3c781bb2fc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.167296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5fdee9d9f042ba9dde6c3c781bb2fc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.175363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.175710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1241/2449] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:05.180060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.192595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a5233-a4e7-40a4-af90-6ac9a6e5fb13 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.198875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.199616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.200388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.200755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.201909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:05.202804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.208479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.224497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1242/2450] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:05.230120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.241043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cc5ef-0f38-4c06-a4b4-e1711f7a9352 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.246287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.247027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.247381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.247728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.248934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.251700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.299011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5fdee9d9f042ba9dde6c3c781bb2fc', 'request_id': 'req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.307087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5fdee9d9f042ba9dde6c3c781bb2fc', 'request_id': 'req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.377016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1243/2451] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:05.380902 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.397144 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5fdee9d9f042ba9dde6c3c781bb2fc', 'request_id': 'req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.410493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] The token cache is being invalidate because project 8e5fdee9d9f042ba9dde6c3c781bb2fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:05.410767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.411479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8cefb9ca-f56c-4709-ae8f-9ba94b1191fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:05.413161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1209/2452] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:04 2022] DELETE /identity/v3/projects/8e5fdee9d9f042ba9dde6c3c781bb2fc => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:05.418299 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bb44-1884-42ac-9390-a7810ca0dc3f None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.418695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bb44-1884-42ac-9390-a7810ca0dc3f None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.418973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601bb44-1884-42ac-9390-a7810ca0dc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.441422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b601bb44-1884-42ac-9390-a7810ca0dc3f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:05.442591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b601bb44-1884-42ac-9390-a7810ca0dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.448682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fb0a5-db5c-490f-abfb-efc8b4718584 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.451042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1210/2453] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:05.453615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.454377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.454612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.454889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.455632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.457751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.458862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.459158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.459439 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.477988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:05.479195 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.488176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1211/2454] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:05.492218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.501622 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9e089-5c25-4c77-8fc9-97e2b808d8f5 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.506437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.509286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.509286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.509286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.509286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:05.509286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.510302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.522440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1212/2455] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:05.527137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.537674 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25779ec9-ba80-4fec-bb67-2fecee55067c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.542483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.543132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.543414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.543695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.544379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.547069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.571127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1244/2456] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:05.575331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.576927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.588728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc1ff-9442-48f0-aae5-57c1ef920935 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.593992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.594641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.594914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.595189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.595957 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.597535 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.609226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1245/2457] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:05.612121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.622144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc37cd-01f8-4d6e-83ba-341a2033fcfa admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.626865 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.630393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.630393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.630393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.630393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.630393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.641223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1246/2458] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:05.645119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.654958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a21e892-eb91-4f06-a0d1-15c48038d50b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.657309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1213/2459] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:05.660849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.716152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.717047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.717324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.717597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] PATH_INFO: `/v3/projects/b70bea0e61d14822ab4f56a13298cc4b/users/2f04c5ee51e44a89a34bf28b1c7282f2/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.732944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48d55c-dcbe-438b-83ed-9a92bda49ecb admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.733164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70bea0e61d14822ab4f56a13298cc4b, user_id=2f04c5ee51e44a89a34bf28b1c7282f2, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.736378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f728fa-52de-44d3-bc8f-8c27b1d74286 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.738579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.739290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.739510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.739786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.740460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.741328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:05.742517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.762932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:05.796622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1247/2460] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:05 2022] PUT /identity/v3/projects/b70bea0e61d14822ab4f56a13298cc4b/users/2f04c5ee51e44a89a34bf28b1c7282f2/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:05.807531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.807817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.808097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.825895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1214/2461] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/users => generated 302 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:05.827132 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.835936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] MFA Rules not processed for user `2f04c5ee51e44a89a34bf28b1c7282f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:05.837178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:05.837656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600f90-2313-48c2-8f69-f0155da588cc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.895684 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.896358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.896636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.896909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.897673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.899246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.903094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1248/2462] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:05.908253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.910713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1215/2463] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:05.914310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.922090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a582bdc-2d36-4b0c-8fd9-8437e7e35373 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.923895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7c402-203d-4cc4-bf54-daedd4567d8f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.926767 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.927424 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.927708 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.927986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.928672 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.929050 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.929710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.930023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.930302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.930617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.931164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.932775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:05.946230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1216/2464] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:05.950697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:05.960826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5445f14-1404-48a3-ba6d-4a41c9ad5949 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:05.965402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:05.966293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:05.967685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:05.968524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] PATH_INFO: `/v3/projects/ea681b573cb74132b350f054969c6d1c/users/35cd4f9bc2f14671be26a266daf7d509/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:05.983689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea681b573cb74132b350f054969c6d1c, user_id=35cd4f9bc2f14671be26a266daf7d509, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:05.986382 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cfc66-1b2c-4bb9-a61c-bb95f1512441 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.064371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1249/2465] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:05 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:06.068363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.091245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1217/2466] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:05 2022] PUT /identity/v3/projects/ea681b573cb74132b350f054969c6d1c/users/35cd4f9bc2f14671be26a266daf7d509/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:06.102022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.102311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.102595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.131468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] MFA Rules not processed for user `35cd4f9bc2f14671be26a266daf7d509`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:06.132908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c143b-d6f1-492e-bb3a-f93b5b298d1d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.133245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:06.189990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.190685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.190972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.191251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.191940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.193914 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.200266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1218/2467] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:06.209620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.220290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07a65c-7504-4570-9b24-3ade4e400a59 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.225124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.226925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.227211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.227494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.228188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.230224 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.271687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1250/2468] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/users => generated 298 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:06.275604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.285164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c7f3a-a1c4-4c3c-886c-defe88a17301 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.289915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.290550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.290827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.291101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.291807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.293405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.303244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1251/2469] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:06.307088 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.317171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee4b01-1635-4af4-9ebb-efba90f6a5e8 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.321772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.322623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.325497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.325497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] PATH_INFO: `/v3/projects/56ee016ca863448fb8a75ed4e822d049/users/78a03f9909574798820816918321ce05/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.338990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ee016ca863448fb8a75ed4e822d049, user_id=78a03f9909574798820816918321ce05, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.341626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.358668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1219/2470] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:06.362537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.424013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf38c2-42c2-4166-9d2f-55f50c747615 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.428763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.429419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.429701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.430005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.430691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.432596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.477121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1252/2471] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:06 2022] PUT /identity/v3/projects/56ee016ca863448fb8a75ed4e822d049/users/78a03f9909574798820816918321ce05/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:06.480879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.550350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6058b0a5-c84d-4c43-856f-574794207487 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.552087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1220/2472] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:06.555324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.572179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.572343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.572343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.572343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.572343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.572343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.572802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1158e-9f8a-4221-b06b-d9112d11c87b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.572894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1253/2473] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:06.573258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.573258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.573465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.573743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.574597 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.575306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.576248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.586015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9409f5-140c-4da3-9b1a-06ea25bda1ea admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.587699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1221/2474] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:06.590745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.591628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.591910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.592076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.592384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] PATH_INFO: `/v3/projects/56ee016ca863448fb8a75ed4e822d049/users/78a03f9909574798820816918321ce05/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.594684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ee016ca863448fb8a75ed4e822d049, user_id=78a03f9909574798820816918321ce05, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.597344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6705b6-e547-4e69-81b7-6edefb559c33 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.602412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbac03-c063-4468-9378-8f81f5493ab7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.612389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1254/2475] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:06 2022] PUT /identity/v3/projects/56ee016ca863448fb8a75ed4e822d049/users/78a03f9909574798820816918321ce05/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:06.621163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.621452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.621750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.649933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] MFA Rules not processed for user `78a03f9909574798820816918321ce05`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:06.651167 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:06.660248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.661164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.662049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.662436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] PATH_INFO: `/v3/projects/73124fef39a04d179aa6ce1c077373f8/users/1baa068a8da3438180a8634a45dfdb88/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.679446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] RBAC: Authorizing `identity:create_grant(project_id=73124fef39a04d179aa6ce1c077373f8, user_id=1baa068a8da3438180a8634a45dfdb88, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.682436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.719765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1255/2476] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:06.731401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.732723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:06.780035 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1222/2477] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:06 2022] PUT /identity/v3/projects/73124fef39a04d179aa6ce1c077373f8/users/1baa068a8da3438180a8634a45dfdb88/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:06.783955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.790194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79b08-83b9-4b4c-84a7-1836c76f519d None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.797119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:06.842728 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.843376 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.843675 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.843918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.850882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be70b45-d207-468e-85d5-f91cbf4ac0af admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.855083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:06.860282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.861420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.861763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.862045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.862818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.864686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.876981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1223/2478] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:06.881075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:06.892592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d0ea6-7029-4e70-937a-39ff794c2e3d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:06.897568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:06.898493 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.898775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.899054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] PATH_INFO: `/v3/projects/73124fef39a04d179aa6ce1c077373f8/users/1baa068a8da3438180a8634a45dfdb88/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.901011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73124fef39a04d179aa6ce1c077373f8, user_id=1baa068a8da3438180a8634a45dfdb88, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.903675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d672f79b-0f0d-49e6-ad0a-165c9abb3418 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.909358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:06.910837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:06.914512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1224/2479] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:06 2022] PUT /identity/v3/projects/73124fef39a04d179aa6ce1c077373f8/users/1baa068a8da3438180a8634a45dfdb88/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:06.920793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1256/2480] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:06.925813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:06.926102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:06.926379 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:06.955906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] MFA Rules not processed for user `1baa068a8da3438180a8634a45dfdb88`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:06.957098 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:07.032457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1225/2481] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:07.043235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:07.052216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cbbf2-520d-4e15-a63c-e126b816fa53 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:07.076546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:07.078689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:07.107998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:07.108701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.108953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.109274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.118604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:07.120032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:07.126421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.131266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1257/2482] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:07.136051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9b43e-598b-4916-bc6d-a795ff6dcaaa None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:07.138948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:07.139627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.139903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.140176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.209899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:07.211352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c474b-3fe2-4181-8419-109f0d087950 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:07.216740 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.224426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1226/2483] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:07.237375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.295300 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:07.343346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.363481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1202e96-c7d3-4a21-8d30-059d50e17a5a service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:07.364789 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:07.365609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.365919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.366339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] PATH_INFO: `/v3/users/35cd4f9bc2f14671be26a266daf7d509` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.367546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cd4f9bc2f14671be26a266daf7d509)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:07.369523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:07.472883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.594076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cd4f9bc2f14671be26a266daf7d509'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.607031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cd4f9bc2f14671be26a266daf7d509'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.687928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cd4f9bc2f14671be26a266daf7d509'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.688586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cd4f9bc2f14671be26a266daf7d509'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.696894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cd4f9bc2f14671be26a266daf7d509'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.703512 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1258/2484] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:07 2022] DELETE /identity/v3/users/35cd4f9bc2f14671be26a266daf7d509 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:07.710152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.710152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.710152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.711393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:07.712759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:07.727090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:07.728287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:07.778005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6278e47-b68f-4bb6-8dbf-b6b0cf453591 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:07.782761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:07.783771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.784155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.784533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] PATH_INFO: `/v3/users/2f04c5ee51e44a89a34bf28b1c7282f2` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.785848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f04c5ee51e44a89a34bf28b1c7282f2)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:07.787875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:07.788973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1227/2485] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:07.799834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:07.801199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:07.840707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=100 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:07.857848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e80ec-b40c-42e5-9007-7bbb2de211dd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:07.863133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:07.863778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:07.864061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:07.864391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:07.876187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:07.877713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc65d7-115f-4cee-8c65-25802c5b9d43 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:07.888118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1228/2486] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:07.951871 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f04c5ee51e44a89a34bf28b1c7282f2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:07.964578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f04c5ee51e44a89a34bf28b1c7282f2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.062125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f04c5ee51e44a89a34bf28b1c7282f2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.062792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f04c5ee51e44a89a34bf28b1c7282f2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.070674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f04c5ee51e44a89a34bf28b1c7282f2'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.077677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1259/2487] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:07 2022] DELETE /identity/v3/users/2f04c5ee51e44a89a34bf28b1c7282f2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:08.082240 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:08.082772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:08.082874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:08.101515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:08.102770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:08.173315 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1229/2488] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:08.182970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:08.184399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:08.214150 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:08.249116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a213-1c19-439d-acd0-fca7c5ff8ef2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:08.253000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:08.253667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:08.255731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:08.255731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:08.263702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:08.265116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:08.274772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1260/2489] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:08.362596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:08.364369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:08.378179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6059d4-3bd2-40ce-8175-dff61b4350ec None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:08.383775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:08.384657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:08.384924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:08.385200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] PATH_INFO: `/v3/projects/ea681b573cb74132b350f054969c6d1c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:08.386564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea681b573cb74132b350f054969c6d1c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:08.388533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:08.529480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea681b573cb74132b350f054969c6d1c', 'request_id': 'req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.536537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea681b573cb74132b350f054969c6d1c', 'request_id': 'req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.600245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea681b573cb74132b350f054969c6d1c', 'request_id': 'req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.614182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] The token cache is being invalidate because project ea681b573cb74132b350f054969c6d1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:08.614480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.615130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.616906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1230/2490] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:08 2022] DELETE /identity/v3/projects/ea681b573cb74132b350f054969c6d1c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:08.620623 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:08.630559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97c0d01-f7d9-434a-a2ba-1befeaa8cdab service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:08.689800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:08.690785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:08.691071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:08.695046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] PATH_INFO: `/v3/users/1baa068a8da3438180a8634a45dfdb88` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:08.695046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1baa068a8da3438180a8634a45dfdb88)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:08.695046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:08.857815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:08.859274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:08.873022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130dcaa-0c6b-4626-9d8c-a89b2da7a12c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:08.878293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:08.879275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:08.879506 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:08.879778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] PATH_INFO: `/v3/projects/b70bea0e61d14822ab4f56a13298cc4b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:08.881708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70bea0e61d14822ab4f56a13298cc4b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:08.883714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:08.916350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1baa068a8da3438180a8634a45dfdb88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:08.928253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1baa068a8da3438180a8634a45dfdb88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.013430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1baa068a8da3438180a8634a45dfdb88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.014075 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1baa068a8da3438180a8634a45dfdb88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.018516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70bea0e61d14822ab4f56a13298cc4b', 'request_id': 'req-9cd7c95b-96b2-4136-8311-df73a7bf68d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.022549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1baa068a8da3438180a8634a45dfdb88'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.025054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70bea0e61d14822ab4f56a13298cc4b', 'request_id': 'req-9cd7c95b-96b2-4136-8311-df73a7bf68d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.027636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:09.028785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1261/2491] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:08 2022] DELETE /identity/v3/users/1baa068a8da3438180a8634a45dfdb88 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:09.122497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70bea0e61d14822ab4f56a13298cc4b', 'request_id': 'req-9cd7c95b-96b2-4136-8311-df73a7bf68d4'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.133689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] The token cache is being invalidate because project b70bea0e61d14822ab4f56a13298cc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:09.134005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.134627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.136168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1231/2492] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:08 2022] DELETE /identity/v3/projects/b70bea0e61d14822ab4f56a13298cc4b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:09.140161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:09.142228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:09.191320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:09.208259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d91af-ed95-4d62-8388-2f2fcb4fc7b4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:09.213325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:09.214244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:09.214519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:09.215118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] PATH_INFO: `/v3/users/78a03f9909574798820816918321ce05` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:09.216032 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a03f9909574798820816918321ce05)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:09.217975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:09.376120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a03f9909574798820816918321ce05'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.387810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a03f9909574798820816918321ce05'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.467997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:09.469600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:09.488195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a03f9909574798820816918321ce05'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.492175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a03f9909574798820816918321ce05'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.497028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f8770f4e-42b0-45e7-88ec-2fbaa56dbfa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a03f9909574798820816918321ce05'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.505362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1262/2493] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:09 2022] DELETE /identity/v3/users/78a03f9909574798820816918321ce05 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:09.552462 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd7c95b-96b2-4136-8311-df73a7bf68d4 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:09.617300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:09.618301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:09.620476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:09.620476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] PATH_INFO: `/v3/projects/73124fef39a04d179aa6ce1c077373f8` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:09.621623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73124fef39a04d179aa6ce1c077373f8)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:09.624841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:09.787198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73124fef39a04d179aa6ce1c077373f8', 'request_id': 'req-dad4247f-2652-4e04-9123-4a84b1413634'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.793833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73124fef39a04d179aa6ce1c077373f8', 'request_id': 'req-dad4247f-2652-4e04-9123-4a84b1413634'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.891470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73124fef39a04d179aa6ce1c077373f8', 'request_id': 'req-dad4247f-2652-4e04-9123-4a84b1413634'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.902657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] The token cache is being invalidate because project 73124fef39a04d179aa6ce1c077373f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:09.902950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.903592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:09.905217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1232/2494] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:09 2022] DELETE /identity/v3/projects/73124fef39a04d179aa6ce1c077373f8 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:09.910773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af975-d840-447c-ab3d-9e90bc85b9da None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:09.911257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af975-d840-447c-ab3d-9e90bc85b9da None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:09.911385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792af975-d840-447c-ab3d-9e90bc85b9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:09.942065 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-792af975-d840-447c-ab3d-9e90bc85b9da None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:09.943328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-792af975-d840-447c-ab3d-9e90bc85b9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.003879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.005440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1263/2495] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:10.007171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.012840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.013129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.013410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.035867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:10.037106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.037314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4247f-2652-4e04-9123-4a84b1413634 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.042076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.042938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.043353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.043475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] PATH_INFO: `/v3/projects/56ee016ca863448fb8a75ed4e822d049` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.044723 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ee016ca863448fb8a75ed4e822d049)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.046192 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1264/2496] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:10.046711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.050524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.060673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0eaa4-1ef3-43bc-b59e-f0e53774071e None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.064946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:10.065420 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.066124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.066408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.066685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.067425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:10.067714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.069315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.082843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1265/2497] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:10.088387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.099366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffcf76e-0f78-4e0d-bf12-1b1e39c10fcf admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.104500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.105187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.105464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.105771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.106456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.108353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.180453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ee016ca863448fb8a75ed4e822d049', 'request_id': 'req-f28f569a-f00b-409a-a7a2-d07debbf775d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:10.186588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ee016ca863448fb8a75ed4e822d049', 'request_id': 'req-f28f569a-f00b-409a-a7a2-d07debbf775d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:10.210346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1266/2498] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:10.214373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.243071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:10.277444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78d116-92bf-4b38-9bca-18e34937fa54 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.282607 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.283275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.283588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.283870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.284557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.286517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.296217 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ee016ca863448fb8a75ed4e822d049', 'request_id': 'req-f28f569a-f00b-409a-a7a2-d07debbf775d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:10.307886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] The token cache is being invalidate because project 56ee016ca863448fb8a75ed4e822d049 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:10.308186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:10.309487 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-f28f569a-f00b-409a-a7a2-d07debbf775d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:10.311255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1233/2499] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:10 2022] DELETE /identity/v3/projects/56ee016ca863448fb8a75ed4e822d049 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:10.315956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37354b3-95f0-4e6d-9bb6-45135f898e93 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.316248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37354b3-95f0-4e6d-9bb6-45135f898e93 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.316530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37354b3-95f0-4e6d-9bb6-45135f898e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.339774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f37354b3-95f0-4e6d-9bb6-45135f898e93 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:10.340987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f37354b3-95f0-4e6d-9bb6-45135f898e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.349471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1234/2500] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:10.356838 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.357130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.357407 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.374171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1267/2501] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:10.375671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:10.376893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.378363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.385480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.385613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1235/2502] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:10.390507 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.394156 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146809c-57db-4563-8029-150d285e14b7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.399049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.399561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980e143f-66e9-4904-ab87-2790fbb5ab94 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.399705 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.399979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.400257 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.401112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.402762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.405166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.405848 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.406636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.406916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.407641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:10.407948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.409549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.417118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1268/2503] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:10.418258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.421738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1236/2504] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:10.428749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bda38-a7e9-4f55-85df-9f7eb4b10e94 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.433609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.434298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.434577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.434698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.434853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.435575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.437160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.444860 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5cc86-ebfb-4b03-b493-b72d80f7d73d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.447296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1269/2505] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:10.451582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.453470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.454184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.454464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.454944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.457361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.457477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.461545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c0c36-23af-4dd2-b221-8ae437792c26 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.466161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.467034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.467310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.467583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] PATH_INFO: `/v3/projects/99d83c74315f4d2595747b74f03ac6f3/users/15d856065b2146d0a96838feeff8d402/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.483788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d83c74315f4d2595747b74f03ac6f3, user_id=15d856065b2146d0a96838feeff8d402, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.487225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f674aaa-5c33-40bb-997e-897c8df064cd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.540958 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1237/2506] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:10.544888 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.569209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1270/2507] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:10 2022] PUT /identity/v3/projects/99d83c74315f4d2595747b74f03ac6f3/users/15d856065b2146d0a96838feeff8d402/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:10.582315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.582600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.582879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.609857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33b584-cb4f-40ea-93d5-b4d1d8442f2c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.612255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] MFA Rules not processed for user `15d856065b2146d0a96838feeff8d402`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:10.612255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:10.667605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.668265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.668546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.668819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.669628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.671572 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.678422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1271/2508] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:10.680272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:10.682901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.693193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e6c20-34ee-4e7f-bd73-779c6051a3df None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.698228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.698899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.699181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.699458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.700159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.702092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.780023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1238/2509] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/users => generated 287 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:10.780256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1272/2510] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/projects => generated 361 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:10.782252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.782974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.792339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ac9a7-48b0-48e6-9d8e-cbac0738fbf2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.823264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:10.847645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d021e-05dc-4395-bc55-9394b64f4528 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.851399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.852070 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.852354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.852465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.852631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.853125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.853359 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.853466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.853674 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.854398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.855037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.856340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.867042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1239/2511] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:10.869249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.879101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c765e17a-c61c-458e-9bc6-1f57ba84ad22 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.883731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.884361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.884644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.884920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.885633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.887366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:10.897961 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1240/2512] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:10.949298 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:10.960243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fec76d-56c3-43a7-a9f5-4d4a442439aa admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:10.964889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:10.965785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:10.966067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:10.966342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] PATH_INFO: `/v3/projects/6ed004bb30a74753a7cdd4e7b4d2a83f/users/c4e28c24e540413d84bb0f876e9c206b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:10.981837 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed004bb30a74753a7cdd4e7b4d2a83f, user_id=c4e28c24e540413d84bb0f876e9c206b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:10.984604 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f953b19-ac49-4fee-a898-8b311ae2398c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.017329 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1273/2513] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:10 2022] POST /identity/v3/users => generated 287 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:11.021305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.031053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9d56e-d8f4-4e41-9b34-5e2b4ecfa952 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.035671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.036310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.036594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.036870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.037589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.039215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.067217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1274/2514] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:11.067396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1241/2515] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:10 2022] PUT /identity/v3/projects/6ed004bb30a74753a7cdd4e7b4d2a83f/users/c4e28c24e540413d84bb0f876e9c206b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:11.069676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.077279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.077567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.078527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.081081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98e75fc-7634-4e62-82fa-9b72a4ae1754 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.106190 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] MFA Rules not processed for user `c4e28c24e540413d84bb0f876e9c206b`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:11.107457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.142030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.143024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.143305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.143576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] PATH_INFO: `/v3/projects/4a77dbdf17764140853bc745f8afbab4/users/52046d62ac13411d84ef10bbb5c7c5c6/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.158577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a77dbdf17764140853bc745f8afbab4, user_id=52046d62ac13411d84ef10bbb5c7c5c6, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.161201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.172535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1242/2516] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:11.183731 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.185112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.230248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1275/2517] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:11 2022] PUT /identity/v3/projects/4a77dbdf17764140853bc745f8afbab4/users/52046d62ac13411d84ef10bbb5c7c5c6/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:11.234186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.234714 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:11.245675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab4ad4-afd6-4eb2-96a6-72ef79f50c13 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.297180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.297905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.298159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.298434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.306496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f272808-7788-4aec-a7b9-224e9b9bf85b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.311572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.312823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.313151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.313430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.314202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.315981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.329645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1276/2518] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:11.333710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.345843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9932e6b-fce5-4ea0-bc8f-d073dee3ced1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.351392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.352522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.352906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.353867 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] PATH_INFO: `/v3/projects/4a77dbdf17764140853bc745f8afbab4/users/52046d62ac13411d84ef10bbb5c7c5c6/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.356037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a77dbdf17764140853bc745f8afbab4, user_id=52046d62ac13411d84ef10bbb5c7c5c6, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.358852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517ed1-fd5e-4728-a686-c38d6baa5898 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.368313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.369795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.376510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1277/2519] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:11 2022] PUT /identity/v3/projects/4a77dbdf17764140853bc745f8afbab4/users/52046d62ac13411d84ef10bbb5c7c5c6/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:11.381390 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1243/2520] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:11.383462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.383812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.384168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.401599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.415320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d9bf-9f92-4f0a-94c0-4bdd7308f245 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.416027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] MFA Rules not processed for user `52046d62ac13411d84ef10bbb5c7c5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:11.417261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.428860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:11.493007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.493923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.494204 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.494479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] PATH_INFO: `/v3/users/c4e28c24e540413d84bb0f876e9c206b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.495729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e28c24e540413d84bb0f876e9c206b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.497664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.502516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1278/2521] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:11.514253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.517283 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.577794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c747946c-636b-4952-b7e0-effbbad9ec6a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.582194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.582781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.583060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.583340 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.593305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.595431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903c25-d0c4-4a86-8275-9b431c07d424 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.606221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1279/2522] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:11.665209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e28c24e540413d84bb0f876e9c206b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:11.673421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:11.680141 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e28c24e540413d84bb0f876e9c206b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:11.753749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e28c24e540413d84bb0f876e9c206b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:11.761323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e28c24e540413d84bb0f876e9c206b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:11.762018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e28c24e540413d84bb0f876e9c206b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:11.768814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1244/2523] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:11 2022] DELETE /identity/v3/users/c4e28c24e540413d84bb0f876e9c206b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:11.773471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.773786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.774071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.792647 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:11.793898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.799794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.801629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.857041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1280/2524] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:11.864649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c42e7-32cd-465c-8803-48542c19029f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.867122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:11.868524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.868766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.869178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.869459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.869742 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.871534 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:11.925267 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:11.929380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a101bec-ab46-4670-b75b-b6178fd69a09 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:11.931620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.933345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.934348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:11.938231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:11.938231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:11.938231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:11.943952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1245/2525] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:11.946046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:11.947490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed676617-3eea-449c-932e-969732e819bc service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:11.961232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1281/2526] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:12.392340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:12.393865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:12.407717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b785b8ac-6cbb-4daa-9f40-aa3f63adca2b service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:12.413186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:12.414045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.414332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.414640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] PATH_INFO: `/v3/projects/6ed004bb30a74753a7cdd4e7b4d2a83f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.415883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed004bb30a74753a7cdd4e7b4d2a83f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:12.417945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:12.515811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed004bb30a74753a7cdd4e7b4d2a83f', 'request_id': 'req-935ebcb3-7e44-4bdc-a32d-964236b01cb2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:12.522057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed004bb30a74753a7cdd4e7b4d2a83f', 'request_id': 'req-935ebcb3-7e44-4bdc-a32d-964236b01cb2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:12.613980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed004bb30a74753a7cdd4e7b4d2a83f', 'request_id': 'req-935ebcb3-7e44-4bdc-a32d-964236b01cb2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:12.625790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] The token cache is being invalidate because project 6ed004bb30a74753a7cdd4e7b4d2a83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:12.626080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:12.626734 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-935ebcb3-7e44-4bdc-a32d-964236b01cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:12.628288 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1246/2527] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:12 2022] DELETE /identity/v3/projects/6ed004bb30a74753a7cdd4e7b4d2a83f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:12.633263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.633791 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.633910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.652164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:12.653370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:12.714723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1282/2528] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:12.723134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.723422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.723707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.742393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:12.743600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:12.751759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1247/2529] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:12.755939 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:12.765693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe246e-1d64-4dba-90a3-2da0da53b9be None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:12.770360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:12.770945 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.771225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.771496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.772211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:12.772510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:12.774122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:12.786164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1283/2530] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:12.790385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:12.796040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:12.800477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1750234-da62-4685-abad-adc2da0cbbdd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:12.805345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:12.806031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.806312 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.806593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.807340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:12.809365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:12.880605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1248/2531] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:12 2022] POST /identity/v3/projects => generated 375 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:12.884499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:12.895493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435cf11c-1833-4898-bff3-5f63667f88c2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:12.951960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:12.952627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:12.953464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:12.953760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:12.954453 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:12.956355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:13.080598 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1284/2532] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:12 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:13.084916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:13.096048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9f312-f112-4253-a5f0-7d61de84ca7b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:13.100789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:13.101449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:13.101741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:13.102033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:13.102765 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:13.104410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:13.115268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1249/2533] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:13.119413 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:13.129591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c13539-c44b-433e-86c4-3fa07ba8a8fb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:13.134439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:13.135020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:13.135298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:13.135571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:13.136412 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:13.138053 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d231e-caf5-4ac7-9535-b4f91fc459e3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:13.148806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1285/2534] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:13.153019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:13.163592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c950e5-8c95-43d4-90e1-698451883cde admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:13.168136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:13.169003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:13.169283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:13.169557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] PATH_INFO: `/v3/projects/464e5ecf6b874dde8c874158c18e5619/users/8a8773a3138d4e3c82d3d83209af69cd/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:13.185075 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=464e5ecf6b874dde8c874158c18e5619, user_id=8a8773a3138d4e3c82d3d83209af69cd, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:13.187748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:13.262835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1250/2535] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:13 2022] PUT /identity/v3/projects/464e5ecf6b874dde8c874158c18e5619/users/8a8773a3138d4e3c82d3d83209af69cd/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:13.275213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:13.275544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:13.275817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:13.302766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] MFA Rules not processed for user `8a8773a3138d4e3c82d3d83209af69cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:13.303977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:13.349270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:13.368731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1286/2536] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:13.381248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:13.382970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:13.443199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefc26d8-d09d-41d1-9cf5-92e32fe07e2b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:13.446915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:13.447557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:13.448107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:13.448383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:13.457508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:13.458963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf7f27-fce0-4e5d-a7d6-6447b44e280c service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:13.468155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1251/2537] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:15.615612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:15.617160 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:15.684122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833493c4-2fa8-4d7b-b9da-7d60861fbb2f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:15.689704 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:15.695101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:15.695101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:15.695101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] PATH_INFO: `/v3/users/15d856065b2146d0a96838feeff8d402` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:15.695101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d856065b2146d0a96838feeff8d402)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:15.695101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:15.879220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d856065b2146d0a96838feeff8d402'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:15.891121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d856065b2146d0a96838feeff8d402'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:15.958925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d856065b2146d0a96838feeff8d402'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:15.959505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d856065b2146d0a96838feeff8d402'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:15.966948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d856065b2146d0a96838feeff8d402'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:15.973648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1287/2538] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:15 2022] DELETE /identity/v3/users/15d856065b2146d0a96838feeff8d402 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:15.978159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:15.978628 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:15.978728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:15.995721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:15.996924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:16.055627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1252/2539] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:16.065360 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:16.066784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:16.123241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2e44-fa71-40ea-8396-63874e46c21c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:16.126891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:16.127525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:16.127803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:16.128077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:16.137187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:16.138467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:16.148298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1288/2540] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:16.592647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:16.594105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:16.606311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61c8cc-1f21-4ddd-95fa-7e7ee65f2502 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:16.612252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:16.613329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:16.613776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:16.614073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] PATH_INFO: `/v3/projects/99d83c74315f4d2595747b74f03ac6f3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:16.615277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d83c74315f4d2595747b74f03ac6f3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:16.617459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:16.746117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:16.748927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d83c74315f4d2595747b74f03ac6f3', 'request_id': 'req-42d156f4-734f-4879-a2a1-8f0345319d4d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:16.755871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d83c74315f4d2595747b74f03ac6f3', 'request_id': 'req-42d156f4-734f-4879-a2a1-8f0345319d4d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:16.821950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d83c74315f4d2595747b74f03ac6f3', 'request_id': 'req-42d156f4-734f-4879-a2a1-8f0345319d4d'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:16.832923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] The token cache is being invalidate because project 99d83c74315f4d2595747b74f03ac6f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:16.833212 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:16.833882 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:16.835480 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1253/2541] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:16 2022] DELETE /identity/v3/projects/99d83c74315f4d2595747b74f03ac6f3 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:16.839436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:16.849233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbb82-3b37-41b8-a7f5-ddf1967de3b8 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:16.854076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:16.909401 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:16.910291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:16.910571 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:16.910845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] PATH_INFO: `/v3/users/52046d62ac13411d84ef10bbb5c7c5c6` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:16.912023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52046d62ac13411d84ef10bbb5c7c5c6)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:16.914022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:17.130225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52046d62ac13411d84ef10bbb5c7c5c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.143153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52046d62ac13411d84ef10bbb5c7c5c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.207971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52046d62ac13411d84ef10bbb5c7c5c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.208584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52046d62ac13411d84ef10bbb5c7c5c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.216180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4e9c5016-c738-4707-8a07-d8361541c21c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52046d62ac13411d84ef10bbb5c7c5c6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.222203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1289/2542] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:16 2022] DELETE /identity/v3/users/52046d62ac13411d84ef10bbb5c7c5c6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:17.664051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:17.664527 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:17.679134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d156f4-734f-4879-a2a1-8f0345319d4d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:17.743922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:17.744923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:17.745237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:17.745516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] PATH_INFO: `/v3/projects/4a77dbdf17764140853bc745f8afbab4` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:17.746768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a77dbdf17764140853bc745f8afbab4)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:17.748677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:17.883189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a77dbdf17764140853bc745f8afbab4', 'request_id': 'req-553960b5-3fbe-47fa-a891-d90b0ac455c8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.890925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a77dbdf17764140853bc745f8afbab4', 'request_id': 'req-553960b5-3fbe-47fa-a891-d90b0ac455c8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.977330 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a77dbdf17764140853bc745f8afbab4', 'request_id': 'req-553960b5-3fbe-47fa-a891-d90b0ac455c8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.997441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] The token cache is being invalidate because project 4a77dbdf17764140853bc745f8afbab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:17.998002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:17.999055 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-553960b5-3fbe-47fa-a891-d90b0ac455c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:18.002443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1254/2543] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:17 2022] DELETE /identity/v3/projects/4a77dbdf17764140853bc745f8afbab4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:18.009783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.010313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.010832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.043499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:18.045587 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:18.142157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1290/2544] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:18.149891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.150179 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.150458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.168894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:18.171104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:18.193764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1255/2545] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:18.198896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.218223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ee72f-6f51-4d10-8473-2c4f086eb6ab None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.224210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.225002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.225173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.225450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.226225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:18.226536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.228730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.241756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1291/2546] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:18.246289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.255934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd4684-0850-426f-9c5a-a1919403683c None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.261668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.262364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.262624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.262892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.263585 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.265481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.396154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1256/2547] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:18.398471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.412492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec3921-0bba-4000-b92b-a41e839d122a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.430307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:18.486399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.487321 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.487711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.488179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.489151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.491891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.581802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1292/2548] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:18.583100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.597188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489f66-e583-4628-b48e-916cdae66cdd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.602650 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.603496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.603794 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.604276 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.605103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.606811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.621871 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1257/2549] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:18.624861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.636104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597ebc2-7846-49fc-a35f-399f4d561b71 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.641530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.643041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.643326 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.643601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.644364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.645996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627f20a7-edce-4734-a46d-f3e27dce5828 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.657455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1293/2550] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:18.661943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.672412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04996dd-a3d2-4331-8c1b-4caa8ea34c78 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.677389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.678400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.678688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.678967 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] PATH_INFO: `/v3/projects/a6e1105b3a8b4151bb4c68d2ccdd11e0/users/2ad8b02c1a49431089f29aad23d1e05b/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.695095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e1105b3a8b4151bb4c68d2ccdd11e0, user_id=2ad8b02c1a49431089f29aad23d1e05b, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.698063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:18.776063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:18.781196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1258/2551] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:18 2022] PUT /identity/v3/projects/a6e1105b3a8b4151bb4c68d2ccdd11e0/users/2ad8b02c1a49431089f29aad23d1e05b/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:18.791612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.791906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.792173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.823516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] MFA Rules not processed for user `2ad8b02c1a49431089f29aad23d1e05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:18.824830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:18.901430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1294/2552] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:18.906213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:18.971184 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6e4f0-65bf-4e61-abc7-d3905e6ff1a2 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:18.976086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:18.976748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:18.977033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:18.977310 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:18.978045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:18.979986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.149357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1259/2553] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:18 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:19.153685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.165612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d51d3-5d35-4cbf-96ae-96292379efd3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.234717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.236175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.236175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.236368 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.237004 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.240104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.355308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1295/2554] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:19 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:19.356556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.370661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8eb18-efb2-4868-bbcf-799aab7e5602 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.378216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.378970 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.379388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.379770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.381142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.383345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.399613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1260/2555] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:19.404434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.420116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5b355-c73e-417e-ab3d-30ce92b0cbe7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.425755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.426331 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.426621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.426971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] PATH_INFO: `/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a/users/0c375cef16b94c608b8d9922f88783cd/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.443239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:19.447251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bac5105a4f4b5ba60d5b0d28748a2a, user_id=0c375cef16b94c608b8d9922f88783cd, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.450270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.556663 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1296/2556] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:19 2022] PUT /identity/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a/users/0c375cef16b94c608b8d9922f88783cd/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:19.558677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.569750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950bf5-42ef-4b64-825d-b98020560503 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.637520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.638565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.638854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.639133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.639863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.641459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb2b0b-be4f-41a1-a258-e6a87aaebf81 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.651897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1261/2557] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:19.656298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.666887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a42a3d-78ba-4608-a6b3-80d1060193a1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.671616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.674925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.674925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.674925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] PATH_INFO: `/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a/users/0c375cef16b94c608b8d9922f88783cd/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.675549 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=88bac5105a4f4b5ba60d5b0d28748a2a, user_id=0c375cef16b94c608b8d9922f88783cd, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.678387 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.689616 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1297/2558] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:19 2022] PUT /identity/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a/users/0c375cef16b94c608b8d9922f88783cd/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:19.701095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.701615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.701760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.732512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] MFA Rules not processed for user `0c375cef16b94c608b8d9922f88783cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:19.733827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:19.795938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:19.805809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1262/2559] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:19.818416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:19.830488 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:19.881220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedba560-1a00-4a58-b754-3b1d14f38ebf admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:19.884888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:19.885533 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:19.885854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:19.886129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:19.896275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:19.897760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:19.907492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1298/2560] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:20.843805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:20.853242 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4a276-abb4-40bc-8f21-2698f466decd None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:20.857900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c375cef16b94c608b8d9922f88783cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88bac5105a4f4b5ba60d5b0d28748a2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:20.858621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:20.858918 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:20.859196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:20.859927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:20.860418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:20.862237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:20.876205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1263/2561] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:20.880495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:20.891954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31ff8f7-8f75-41ae-b51a-4d836675b2df service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:20.898765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c375cef16b94c608b8d9922f88783cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88bac5105a4f4b5ba60d5b0d28748a2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:20.899438 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:20.899781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:20.899998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:20.900682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:20.903380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:21.103760 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1299/2562] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:20 2022] POST /identity/v3/projects => generated 354 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:21.107993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:21.118477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb6081-2b0f-422e-9cb9-64fcb1070541 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:21.175227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c375cef16b94c608b8d9922f88783cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88bac5105a4f4b5ba60d5b0d28748a2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:21.175880 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:21.176168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:21.176449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:21.177196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:21.177504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:21.179130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:21.191801 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1264/2563] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:21.238799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:21.249217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dadbcd-e564-44eb-8e28-0145cc2a0b2a tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:21.254577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c375cef16b94c608b8d9922f88783cd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '88bac5105a4f4b5ba60d5b0d28748a2a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:21.255427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:21.255715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:21.255994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] PATH_INFO: `/v3/projects/f24a9afb55dc41ea9a15bf559ba715e1` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:21.257171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f24a9afb55dc41ea9a15bf559ba715e1)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:21.259152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:21.381496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24a9afb55dc41ea9a15bf559ba715e1', 'request_id': 'req-1833ae72-bf6d-44c7-b590-4ad81e6b5724'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:21.387958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24a9afb55dc41ea9a15bf559ba715e1', 'request_id': 'req-1833ae72-bf6d-44c7-b590-4ad81e6b5724'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:21.394287 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24a9afb55dc41ea9a15bf559ba715e1', 'request_id': 'req-1833ae72-bf6d-44c7-b590-4ad81e6b5724'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:21.502091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] The token cache is being invalidate because project f24a9afb55dc41ea9a15bf559ba715e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:21.502431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:21.503039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-1833ae72-bf6d-44c7-b590-4ad81e6b5724 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:21.504625 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1300/2564] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:21 2022] DELETE /identity/v3/projects/f24a9afb55dc41ea9a15bf559ba715e1 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:22.317176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:22.319342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:22.391108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aee84d-ea27-42f5-9ed9-32c8f40fe3a9 tempest-VolumeQuotaClassesTest-1052906965 tempest-VolumeQuotaClassesTest-1052906965-project-admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:22.448438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:22.449226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:22.449508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:22.449816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] PATH_INFO: `/v3/users/2ad8b02c1a49431089f29aad23d1e05b` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:22.451001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad8b02c1a49431089f29aad23d1e05b)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:22.452924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:22.577193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:22.715203 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad8b02c1a49431089f29aad23d1e05b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:22.738021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad8b02c1a49431089f29aad23d1e05b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:22.819355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad8b02c1a49431089f29aad23d1e05b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:22.827643 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad8b02c1a49431089f29aad23d1e05b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:22.828815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad8b02c1a49431089f29aad23d1e05b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:22.834455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1265/2565] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:22 2022] DELETE /identity/v3/users/2ad8b02c1a49431089f29aad23d1e05b => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:22.839356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:22.839827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:22.839922 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:22.857479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:22.863365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:22.893263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:22.917775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1301/2566] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:22.928045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:22.929478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:23.018291 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ff118-d6e9-4e5e-b0e1-b30bff7ca876 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:23.023952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:23.023952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:23.023952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:23.023952 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:23.039716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:23.041861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:23.055409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1266/2567] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:23.500710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:23.502404 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:23.516978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f350ee-bda1-4d1a-a7ef-0f8e6f361751 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:23.522528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:23.523396 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:23.523676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:23.523949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] PATH_INFO: `/v3/projects/a6e1105b3a8b4151bb4c68d2ccdd11e0` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:23.525155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e1105b3a8b4151bb4c68d2ccdd11e0)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:23.527101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:23.644873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e1105b3a8b4151bb4c68d2ccdd11e0', 'request_id': 'req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:23.651509 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e1105b3a8b4151bb4c68d2ccdd11e0', 'request_id': 'req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:23.657379 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e1105b3a8b4151bb4c68d2ccdd11e0', 'request_id': 'req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:23.768470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] The token cache is being invalidate because project a6e1105b3a8b4151bb4c68d2ccdd11e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:23.768763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:23.775225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:23.775225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1302/2568] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:23 2022] DELETE /identity/v3/projects/a6e1105b3a8b4151bb4c68d2ccdd11e0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:23.775782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:23.785207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352c3d5-9ce6-411b-8459-cd0cae8ddb05 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:23.842754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:23.843758 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:23.844051 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:23.844412 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] PATH_INFO: `/v3/users/0c375cef16b94c608b8d9922f88783cd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:23.845689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c375cef16b94c608b8d9922f88783cd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:23.847733 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:24.071320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c375cef16b94c608b8d9922f88783cd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.072748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:24.084289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c375cef16b94c608b8d9922f88783cd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.143313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:24.144738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:24.187637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c375cef16b94c608b8d9922f88783cd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.195774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c375cef16b94c608b8d9922f88783cd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.196518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c375cef16b94c608b8d9922f88783cd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.201562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399a661a-9a3d-47b2-9c93-d1dc7008cb7d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:24.211612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1267/2569] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:23 2022] DELETE /identity/v3/users/0c375cef16b94c608b8d9922f88783cd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:24.262613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:24.263748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:24.264269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:24.264779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:24.268096 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:24.308656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:24.339487 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:24.340925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e3d84-9793-4322-8a46-48180ae72050 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:24.350814 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1303/2570] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:24.801778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:24.803366 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:24.817225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b5e75-fba1-45cf-9909-1ef81eb3c6dd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:24.821938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:24.823066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:24.823350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:24.823655 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] PATH_INFO: `/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:24.824942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=88bac5105a4f4b5ba60d5b0d28748a2a)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:24.826943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:24.978793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88bac5105a4f4b5ba60d5b0d28748a2a', 'request_id': 'req-517312a5-3ca8-4083-aab2-61f07c1d5bbf'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:24.988329 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88bac5105a4f4b5ba60d5b0d28748a2a', 'request_id': 'req-517312a5-3ca8-4083-aab2-61f07c1d5bbf'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:25.082923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88bac5105a4f4b5ba60d5b0d28748a2a', 'request_id': 'req-517312a5-3ca8-4083-aab2-61f07c1d5bbf'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:25.095497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] The token cache is being invalidate because project 88bac5105a4f4b5ba60d5b0d28748a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:25.095909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:25.097068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-517312a5-3ca8-4083-aab2-61f07c1d5bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:25.100887 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1268/2571] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:24 2022] DELETE /identity/v3/projects/88bac5105a4f4b5ba60d5b0d28748a2a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:25.104665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.105094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.105507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.140069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:25.143967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:25.238184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1304/2572] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:25.245850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.246138 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.246414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.265578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:25.266815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:25.275392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1269/2573] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:25.279604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.290282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b79fa0-7aec-4413-a94f-787f37b2c0fa None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.295171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.295884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.296168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.296578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.297421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:25.297740 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.299388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.316241 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1305/2574] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:25.317549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.327942 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8f7c6-66c6-4793-8380-4b7c6234d350 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.338541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.339244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.339524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.339853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.340523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.342557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.438090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1270/2575] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:25.439977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.451928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab69e14e-2615-4d80-9e62-5e84bacae45f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.512815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.513470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.513770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.514046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.514725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.516632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.598030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1306/2576] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:25.599352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.610828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92de4e-e8c8-4c26-a5be-73b747e00f66 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.616494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.618026 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.618307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.618762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.619502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.622064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.637154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1271/2577] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:25.638059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.648685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a97536-d297-4cde-a793-11e46895c4c6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.653435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.654157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.654551 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.654778 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.655547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.657243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7376d3f4-7de9-41c8-b9d4-f4ae791b7545 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.668456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1307/2578] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:25.672754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.683349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b8f4c-40b8-494a-bb1c-90d83af8844f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:25.688149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:25.688971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.689256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.689589 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] PATH_INFO: `/v3/projects/3178357276a542dcb6173ef96e047f20/users/18773dd91abd4b9b92c73e787731c782/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.711701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3178357276a542dcb6173ef96e047f20, user_id=18773dd91abd4b9b92c73e787731c782, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:25.714402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:25.807425 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1272/2579] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:25 2022] PUT /identity/v3/projects/3178357276a542dcb6173ef96e047f20/users/18773dd91abd4b9b92c73e787731c782/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:25.816414 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:25.816701 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:25.818449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:25.850457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] MFA Rules not processed for user `18773dd91abd4b9b92c73e787731c782`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:25.851665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:25.881338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:25.929775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1308/2580] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:25.933443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:25.988904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:26.007817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9430601-3819-4a5f-ac36-7486195a9d58 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.017987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.018652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.018932 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.019263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.020126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.022117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.132719 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1273/2581] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:25 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:26.136455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.147122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb07f7d-a500-4e3e-bb2a-ced044d3511b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.212847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.213655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.214043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.214484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.218384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.221125 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.370718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1309/2582] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:26 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:26.375747 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.388873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43173ee5-3762-481a-baec-33e5736fa46c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.395820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.396059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.396178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.396582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.397501 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.399285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.413785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1274/2583] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:26.417151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.438827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f3941-0a8b-480b-99b4-a58654cacc05 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.442794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.444069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.444362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.444822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] PATH_INFO: `/v3/projects/f4a9080e9f12461680379fcaa213f06e/users/9e5392c812f645979ca34303cd05ff86/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.465626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a9080e9f12461680379fcaa213f06e, user_id=9e5392c812f645979ca34303cd05ff86, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.469020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.560678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1310/2584] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:26 2022] PUT /identity/v3/projects/f4a9080e9f12461680379fcaa213f06e/users/9e5392c812f645979ca34303cd05ff86/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:26.565045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.575792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea96fb-3360-48b6-b964-6e7ce59def73 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.648672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.649777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.649777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.650207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.651007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.652713 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ff620-c1a6-482c-a12b-0a9c17f516e6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.674423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1275/2585] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:26.675374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.688876 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3589961-b280-4752-9df7-3c33b5baff61 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:26.696610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:26.698140 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.701395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.701395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] PATH_INFO: `/v3/projects/f4a9080e9f12461680379fcaa213f06e/users/9e5392c812f645979ca34303cd05ff86/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.701395 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a9080e9f12461680379fcaa213f06e, user_id=9e5392c812f645979ca34303cd05ff86, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:26.704051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:26.719550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1311/2586] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:26 2022] PUT /identity/v3/projects/f4a9080e9f12461680379fcaa213f06e/users/9e5392c812f645979ca34303cd05ff86/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:26.730539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:26.730950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:26.731263 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:26.771708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] MFA Rules not processed for user `9e5392c812f645979ca34303cd05ff86`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:26.773370 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:26.902364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1276/2587] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:26.910151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:26.911913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:27.038431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79119a-401f-4c6a-9f98-d6be1ea9592c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:27.042155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:27.042798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:27.043076 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:27.043374 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:27.055773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:27.057348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:27.069226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1312/2588] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:27.181478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:27.193304 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db9b87-24f8-40cb-bd3d-58edb29fb391 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:27.197137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:27.198323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:27.198665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:27.198867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:27.256290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:27.274951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:27.276319 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:27.286929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1277/2589] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:28.588829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:28.590328 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:28.614182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:28.656669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc87448-179a-4fb0-ad42-ef5a17e6a8f1 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:28.661166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:28.662035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:28.662310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:28.662578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] PATH_INFO: `/v3/users/c42165e400c247aba309d3c7a370f476` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:28.663738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42165e400c247aba309d3c7a370f476)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:28.665633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:28.883811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42165e400c247aba309d3c7a370f476'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:28.896197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42165e400c247aba309d3c7a370f476'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.021225 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42165e400c247aba309d3c7a370f476'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.021923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42165e400c247aba309d3c7a370f476'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.029818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-3083842d-64e2-4d2d-b6cb-548c4c6d8f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42165e400c247aba309d3c7a370f476'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.036348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1313/2590] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:28 2022] DELETE /identity/v3/users/c42165e400c247aba309d3c7a370f476 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:29.372328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:29.385593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e629e-413e-43ce-a382-33b4c70b7289 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:29.445563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:29.446458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:29.446741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:29.447020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] PATH_INFO: `/v3/projects/a9d41711e9f54435a9f5c5eb8906c9ff` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:29.448466 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9d41711e9f54435a9f5c5eb8906c9ff)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:29.450424 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:29.584218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9d41711e9f54435a9f5c5eb8906c9ff', 'request_id': 'req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.590786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9d41711e9f54435a9f5c5eb8906c9ff', 'request_id': 'req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.713307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9d41711e9f54435a9f5c5eb8906c9ff', 'request_id': 'req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.725451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] The token cache is being invalidate because project a9d41711e9f54435a9f5c5eb8906c9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:29.725773 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.726581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9fb6fc2d-4639-4d19-a48f-10a590f2a93b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:29.728430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1278/2591] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:29 2022] DELETE /identity/v3/projects/a9d41711e9f54435a9f5c5eb8906c9ff => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:29.733259 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:29.733747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:29.733984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:29.752659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:29.754182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:29.820991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1314/2592] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:29.829861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:29.830147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:29.830421 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:29.849145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:29.850376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:29.858594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1279/2593] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:29.863580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:29.874105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8692dbb-aae6-4f88-ac1a-ab99ac573c30 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:29.879023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:29.879686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:29.879978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:29.880256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:29.880982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:29.881291 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:29.882995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:29.895040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1315/2594] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:29.899353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:29.909420 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bde3b-f522-47c2-99a1-53b4c8149832 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:29.914358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:29.915018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:29.915303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:29.919151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:29.919151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:29.919151 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.020781 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1280/2595] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:29 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:30.021887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.032163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d00688-416f-4bf9-a26a-26f14a1ea215 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.058071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:30.092073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.092749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.093029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.093324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.094029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.096583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.181506 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1316/2596] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:30 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:30.185540 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.195977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2ea79-d3eb-44f1-be6d-7cda53766b0c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.201503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.202273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.202551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.202828 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.203552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.205703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.217938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1281/2597] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:30.222733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.233009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880f030-0116-405a-a7aa-5f48d5f88489 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.238293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.238951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.239228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.239500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.240229 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.241839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56149586-75b8-4dfa-9969-20c2602cd051 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.252005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1317/2598] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:30.256642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.266707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde8c59-ccd0-409f-bd88-97251e8a3011 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.277451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.277451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.277451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.277451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] PATH_INFO: `/v3/projects/fe57d73a1e6c4645bdabef43c87ebc7c/users/146beff435104ea4aca9402ca5c5a349/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.288775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe57d73a1e6c4645bdabef43c87ebc7c, user_id=146beff435104ea4aca9402ca5c5a349, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.291698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.409636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1282/2599] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:30 2022] PUT /identity/v3/projects/fe57d73a1e6c4645bdabef43c87ebc7c/users/146beff435104ea4aca9402ca5c5a349/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:30.421683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.422031 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.422286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.449475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] MFA Rules not processed for user `146beff435104ea4aca9402ca5c5a349`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:30.450753 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:30.514508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1318/2600] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:30.519919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.525509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:30.584352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7180f6-ddd3-4187-b6e8-6a89aa4a8f63 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.590661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.590661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:30.590869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.590869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.591164 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.591443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.592229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.594272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.604181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d70ea-bb6f-4bf1-8636-3b9287d7fbe1 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.609133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.610048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.610330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.610631 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] PATH_INFO: `/v3/users/18773dd91abd4b9b92c73e787731c782` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.612489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=18773dd91abd4b9b92c73e787731c782)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.614500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.714939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1283/2601] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:30 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:30.718902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.782489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e655d-891a-4fa8-9351-2e494901d165 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.787890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.788479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.788761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.789040 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.789759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.791704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.839990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18773dd91abd4b9b92c73e787731c782'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:30.852460 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18773dd91abd4b9b92c73e787731c782'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:30.911791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1284/2602] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:30 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:30.915811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.925548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e6fa-3c8a-4d5f-8b63-7095931ab41d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.927880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18773dd91abd4b9b92c73e787731c782'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:30.928490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18773dd91abd4b9b92c73e787731c782'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:30.930583 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:30.931281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.931568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.931849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.932581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:30.934208 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:30.936915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-fe62b5f1-db07-46ff-9184-d39a8d30cdcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18773dd91abd4b9b92c73e787731c782'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:30.943669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1319/2603] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:30 2022] DELETE /identity/v3/users/18773dd91abd4b9b92c73e787731c782 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:30.945560 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1285/2604] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:30.948888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:30.948888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:30.949152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:30.950011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:30.951695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:30.962021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:30.964922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018eb146-baae-4615-8d62-ea0f8bbc4b71 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:30.968165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:30.977021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.023949 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.024859 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.025146 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.025422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] PATH_INFO: `/v3/projects/00e7833f4ed84961aea0a278ee877913/users/b0e5d387a7ac42e6b78404708b0b11ed/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.031896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1320/2605] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:31.038909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:31.042339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.042556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7833f4ed84961aea0a278ee877913, user_id=b0e5d387a7ac42e6b78404708b0b11ed, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.043968 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.045039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.102936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bc9be-e893-4c48-8e6c-2684c328db77 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.106576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.107215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.107495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.107766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.117317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.118776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.128582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1321/2606] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:31.153314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1286/2607] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:30 2022] PUT /identity/v3/projects/00e7833f4ed84961aea0a278ee877913/users/b0e5d387a7ac42e6b78404708b0b11ed/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:31.157473 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.168179 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea1892-d3cf-4b27-b8d1-40cd962a38ab service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.229965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.230667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.230950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.231228 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.231959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.233554 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339ba3f1-6ddf-4d60-a0a8-645eda4971d3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.243733 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1322/2608] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:31.248230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.259718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8369f09-f634-492a-9039-1c9157dabba7 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.264774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.265671 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.266233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.266515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] PATH_INFO: `/v3/projects/00e7833f4ed84961aea0a278ee877913/users/b0e5d387a7ac42e6b78404708b0b11ed/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.269183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e7833f4ed84961aea0a278ee877913, user_id=b0e5d387a7ac42e6b78404708b0b11ed, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.271819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.282258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1287/2609] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:31 2022] PUT /identity/v3/projects/00e7833f4ed84961aea0a278ee877913/users/b0e5d387a7ac42e6b78404708b0b11ed/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:31.292454 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.292742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.293054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.321433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] MFA Rules not processed for user `b0e5d387a7ac42e6b78404708b0b11ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:31.322982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.380302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:31.403632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1323/2610] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:31 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:31.417025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.418800 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.480273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccd89-7ac9-47df-a154-ea239a8530fc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.484134 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.484808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.485090 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.485369 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.494824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.496280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.506563 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1288/2611] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:31.581883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.583382 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.652366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643f5952-85d8-4ed5-a534-e8995c4ad7eb None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.657002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.657892 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.658170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.658442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] PATH_INFO: `/v3/projects/3178357276a542dcb6173ef96e047f20` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.659628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3178357276a542dcb6173ef96e047f20)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.661565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.738199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.746814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743558cf-a3e4-48ca-b66f-daa2ad28c78e service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.750496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.751129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.751406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.751678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.754211 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:31.777308 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3178357276a542dcb6173ef96e047f20', 'request_id': 'req-9703f00c-f315-4545-af08-9d84ff9cdc67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:31.783540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3178357276a542dcb6173ef96e047f20', 'request_id': 'req-9703f00c-f315-4545-af08-9d84ff9cdc67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:31.789665 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3178357276a542dcb6173ef96e047f20', 'request_id': 'req-9703f00c-f315-4545-af08-9d84ff9cdc67'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:31.819508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.821227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.831108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1289/2612] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:31.890574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] The token cache is being invalidate because project 3178357276a542dcb6173ef96e047f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:31.895568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:31.895568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:31.895568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1324/2613] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:31 2022] DELETE /identity/v3/projects/3178357276a542dcb6173ef96e047f20 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:31.898555 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:31.910104 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc1f06-f77e-42a1-9320-12e29a3acf5d service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:31.972320 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:31.974115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:31.974396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:31.974677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] PATH_INFO: `/v3/users/9e5392c812f645979ca34303cd05ff86` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:31.975897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e5392c812f645979ca34303cd05ff86)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:31.977864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:31.999787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:32.206902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e5392c812f645979ca34303cd05ff86'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:32.219919 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e5392c812f645979ca34303cd05ff86'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:32.297878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e5392c812f645979ca34303cd05ff86'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:32.306993 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e5392c812f645979ca34303cd05ff86'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:32.307715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-10486ab6-1fdd-4f13-bb65-768c60ff5c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e5392c812f645979ca34303cd05ff86'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:32.320352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1290/2614] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:31 2022] DELETE /identity/v3/users/9e5392c812f645979ca34303cd05ff86 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:32.833677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:32.833677 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:32.844567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9703f00c-f315-4545-af08-9d84ff9cdc67 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:32.905931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:32.906784 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:32.907063 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:32.907334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] PATH_INFO: `/v3/projects/f4a9080e9f12461680379fcaa213f06e` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:32.908499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a9080e9f12461680379fcaa213f06e)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:32.910475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:32.913165 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:33.090325 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a9080e9f12461680379fcaa213f06e', 'request_id': 'req-91438471-0e7b-4753-8e6a-b5dcacb2f405'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.096591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a9080e9f12461680379fcaa213f06e', 'request_id': 'req-91438471-0e7b-4753-8e6a-b5dcacb2f405'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.102098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a9080e9f12461680379fcaa213f06e', 'request_id': 'req-91438471-0e7b-4753-8e6a-b5dcacb2f405'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.239498 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] The token cache is being invalidate because project f4a9080e9f12461680379fcaa213f06e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:33.239862 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.242005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.243588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1325/2615] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:32 2022] DELETE /identity/v3/projects/f4a9080e9f12461680379fcaa213f06e => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:33.258047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00df0-b76f-4ed8-a697-6ce44cba1d32 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.258510 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00df0-b76f-4ed8-a697-6ce44cba1d32 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.258652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e00df0-b76f-4ed8-a697-6ce44cba1d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.277325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a3e00df0-b76f-4ed8-a697-6ce44cba1d32 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:33.278575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a3e00df0-b76f-4ed8-a697-6ce44cba1d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.320989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.322750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.344073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1291/2616] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:33.352066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.352404 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.352505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.373348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:33.374664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.384779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1292/2617] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:33.391188 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.403030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91438471-0e7b-4753-8e6a-b5dcacb2f405 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.406251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0fa23-b820-4af4-ba2c-7af3ef27e23b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.408322 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.409585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.409965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.410298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] PATH_INFO: `/v3/users/8a8773a3138d4e3c82d3d83209af69cd` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.411395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.412002 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8773a3138d4e3c82d3d83209af69cd)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.412125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.412356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.412632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.413367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:33.413852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.414542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.415437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.435029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1293/2618] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:33.439620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.450422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc9666f-139a-42ac-bbdd-c23e3f4fb27b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.455176 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.455857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.456150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.456426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.457111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.459048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.560496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1294/2619] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:33 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:33.564568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.623332 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:33.627032 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2faeab7-826b-4bab-9bdc-096efa89fd9b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.631836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.632512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.632791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.633068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.633780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.635692 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.657967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8773a3138d4e3c82d3d83209af69cd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.670996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8773a3138d4e3c82d3d83209af69cd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.745601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1295/2620] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:33 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:33.749885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.759611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47947dd-7b24-47ff-a8da-1a448ee2e201 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.764205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.764835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.765117 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.765393 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.766178 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.767877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.768317 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8773a3138d4e3c82d3d83209af69cd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.768999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8773a3138d4e3c82d3d83209af69cd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.779023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a1b85f3-897d-497c-9dc7-8ac92fb6f45a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8773a3138d4e3c82d3d83209af69cd'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:33.784660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1296/2621] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:33.786289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.788023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.792824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1326/2622] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:33 2022] DELETE /identity/v3/users/8a8773a3138d4e3c82d3d83209af69cd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:33.797227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.797633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.797885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.801465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0647c0f2-da60-4bcb-88c3-710ba93a8794 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.816118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:33.817345 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.822816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:33.858818 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.859586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.859771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.860048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.860784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.862513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.872789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1297/2623] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:33 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:33.876934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.883355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1327/2624] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:33.889451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c135c-728a-4adf-b44f-ed8e4ddc835e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.893689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:33.900667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:33.900902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.900902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.900902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.900902 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] PATH_INFO: `/v3/projects/9c4d6a64fca2414f8b46ebe3399c6f07/users/9c32e954f24e4092a0079fa17c9ba6d7/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.915306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c4d6a64fca2414f8b46ebe3399c6f07, user_id=9c32e954f24e4092a0079fa17c9ba6d7, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.918183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.954879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe201274-f7d9-4418-9f0d-985285f65882 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:33.959339 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:33.959980 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:33.960269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:33.960543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:33.970624 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:33.972673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bcb5b6-8ba7-47bf-a61c-254042a638b5 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:33.982227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1328/2625] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:34.000235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1298/2626] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:33 2022] PUT /identity/v3/projects/9c4d6a64fca2414f8b46ebe3399c6f07/users/9c32e954f24e4092a0079fa17c9ba6d7/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:34.011352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8767-040f-4356-af48-f3c376589935 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.011768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8767-040f-4356-af48-f3c376589935 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.012169 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8767-040f-4356-af48-f3c376589935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.041332 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-37bc8767-040f-4356-af48-f3c376589935 None None] MFA Rules not processed for user `9c32e954f24e4092a0079fa17c9ba6d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:34.042629 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-37bc8767-040f-4356-af48-f3c376589935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.117306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1329/2627] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:34.118670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.234192 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c6ff95-163b-4558-bfac-a1938d718f6b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.239145 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.239855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.240339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.240617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.241341 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.243280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.329964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1299/2628] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/projects => generated 377 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:34.334656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8767-040f-4356-af48-f3c376589935 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.345351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8767-040f-4356-af48-f3c376589935 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.389707 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.391778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.395717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:34.425042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.425824 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.426023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.426295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.426978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.428889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.441543 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:34.471231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462be671-9f49-4dcb-9e23-b6f0860dc1df admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.476140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.476985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.477265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.477541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] PATH_INFO: `/v3/projects/464e5ecf6b874dde8c874158c18e5619` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.478744 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] RBAC: Authorizing `identity:delete_project(project_id=464e5ecf6b874dde8c874158c18e5619)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.480683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.503028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1330/2629] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:34.504910 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.514127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a7ba1f-0a78-4f2d-a44e-f3e8fa0e4704 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.519606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.520261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.520564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.520834 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.527501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.527501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.533384 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1331/2630] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:34.537310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.547115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105fbe0-c89e-4120-9993-70be6af19037 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.552895 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.556176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.556176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.556176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.556176 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.556511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.567809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1332/2631] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:34.571845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.582247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610020a-e499-4152-9d76-d4abba4d3edc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.593810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464e5ecf6b874dde8c874158c18e5619', 'request_id': 'req-575536cd-a412-4e3c-8090-eea9924bb0da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:34.600426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464e5ecf6b874dde8c874158c18e5619', 'request_id': 'req-575536cd-a412-4e3c-8090-eea9924bb0da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:34.637754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.638572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.638854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.639133 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] PATH_INFO: `/v3/projects/2b3f4746a30a4967b800e1e76b70fb85/users/29dbf73a633b473aa60a8b71330406ab/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.653781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3f4746a30a4967b800e1e76b70fb85, user_id=29dbf73a633b473aa60a8b71330406ab, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.656399 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50376cfa-29de-4181-bbf0-8e4e483c1e8d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.672577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464e5ecf6b874dde8c874158c18e5619', 'request_id': 'req-575536cd-a412-4e3c-8090-eea9924bb0da'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:34.683728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] The token cache is being invalidate because project 464e5ecf6b874dde8c874158c18e5619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:34.684010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:34.684645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-575536cd-a412-4e3c-8090-eea9924bb0da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:34.686221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1300/2632] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:34 2022] DELETE /identity/v3/projects/464e5ecf6b874dde8c874158c18e5619 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:34.691417 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c345-f425-4be5-b9c4-2c026fa2e149 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.691700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c345-f425-4be5-b9c4-2c026fa2e149 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.691974 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7c345-f425-4be5-b9c4-2c026fa2e149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.709648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-64e7c345-f425-4be5-b9c4-2c026fa2e149 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:34.711115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-64e7c345-f425-4be5-b9c4-2c026fa2e149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.718778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1301/2633] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:34.726715 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.727001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.727274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.745129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:34.746325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.754737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1302/2634] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:34.758763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.762913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1333/2635] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:34 2022] PUT /identity/v3/projects/2b3f4746a30a4967b800e1e76b70fb85/users/29dbf73a633b473aa60a8b71330406ab/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:34.767576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824e129-4e53-4179-8e10-4a5b3bad6cec None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.777776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.778080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.778365 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.807215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] MFA Rules not processed for user `29dbf73a633b473aa60a8b71330406ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:34.808542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.825457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.826154 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.826440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.826721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.827453 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:34.827761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.829354 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.841458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1303/2636] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:28:34.845679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.855944 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6ced-8988-445b-86b1-323d041d6a91 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.860809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.861467 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.861737 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.862724 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.863275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.865181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:34.882310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1334/2637] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:34.886898 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:34.888237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:34.901284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f42135-3d4d-4552-ae9a-d46f301c4ae8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:34.906178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:34.906829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:34.907113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:34.907431 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:34.908115 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:34.910054 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.009847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1304/2638] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:35.013980 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.038816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:35.062693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1335/2639] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:34 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:35.067146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.071700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:35.074824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c558b5-8dc1-4382-9460-c0644b1d54e6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.130878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae137184-273c-4586-b935-6a3102115dcc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.132388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.133084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.133440 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.133709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.134490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.135589 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.136309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.136469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.136585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.136853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.137528 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.139539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.217431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1305/2640] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:35.221934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.225505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1336/2641] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/users => generated 296 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:35.229448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.236816 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54bb5b-d3b8-4716-a57c-56098931a6ce admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.240505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc4a0-8e83-4d91-bed1-7881d8897905 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.243739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.244406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.244817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.245046 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.245813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.245952 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.246661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.247136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.247406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.247556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.248341 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.250098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.261172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1337/2642] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:35.265269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.269564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1306/2643] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:35.275790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa71c9a1-7503-4c35-bac7-b39f681203fe admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.276905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.280737 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.281630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.281948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.282310 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] PATH_INFO: `/v3/projects/157c4b292c244a88bd0cf778b17cd700/users/e095e451b1484b7aa52eb4a2e9675dd1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.289209 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8635e7-5870-4e47-ad00-e4b6f355cd44 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.295343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.295343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.295621 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.295897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.296610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.298318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.303684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=157c4b292c244a88bd0cf778b17cd700, user_id=e095e451b1484b7aa52eb4a2e9675dd1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.306451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.309668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1307/2644] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:35.313745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.325091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaa262-5c43-4236-a555-988ef449fc00 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.329870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.331287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.331870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.331870 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] PATH_INFO: `/v3/projects/9731237b2c5b4e61a73f5ed5cda43161/users/81bee0810816412fb20a6d8e710ea0ba/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.351344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9731237b2c5b4e61a73f5ed5cda43161, user_id=81bee0810816412fb20a6d8e710ea0ba, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.354497 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feeb622-71c2-4912-a9a0-effae1aaa4dd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.412971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1338/2645] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:35 2022] PUT /identity/v3/projects/157c4b292c244a88bd0cf778b17cd700/users/e095e451b1484b7aa52eb4a2e9675dd1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:35.416938 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.431174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1308/2646] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:35 2022] PUT /identity/v3/projects/9731237b2c5b4e61a73f5ed5cda43161/users/81bee0810816412fb20a6d8e710ea0ba/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:35.443763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.444229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.444606 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.476344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] MFA Rules not processed for user `81bee0810816412fb20a6d8e710ea0ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:35.477667 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:35.487812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b0fbe-a683-4347-a465-0323dd2321e7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.546318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1309/2647] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:35.550726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.551592 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.552270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.552558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.552835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.553566 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.555298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.556107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:35.560946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:35.562556 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60654570-d019-4b7e-b73f-df880becbb44 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.567278 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.567744 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1339/2648] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:28:35.567948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.568199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.568536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.569166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.571080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.572464 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.583430 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4eba3c-c09d-4fb0-a3d7-2def7e57d312 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.588152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.589016 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.589497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.589805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] PATH_INFO: `/v3/projects/157c4b292c244a88bd0cf778b17cd700/users/e095e451b1484b7aa52eb4a2e9675dd1/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.591804 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=157c4b292c244a88bd0cf778b17cd700, user_id=e095e451b1484b7aa52eb4a2e9675dd1, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.594479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cd125-c12d-4c31-910b-54d411652d2b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.605621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1340/2649] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:35 2022] PUT /identity/v3/projects/157c4b292c244a88bd0cf778b17cd700/users/e095e451b1484b7aa52eb4a2e9675dd1/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:35.616439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.616731 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.617015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.648580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] MFA Rules not processed for user `e095e451b1484b7aa52eb4a2e9675dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:35.650293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:35.740755 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1341/2650] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:35.754118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:35.755508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:35.811779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdf3bf-a476-4d86-8842-23c249cf1f82 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:35.815523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:35.816180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:35.816448 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:35.816724 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:35.826104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:35.827601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:35.837119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1342/2651] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:35.937756 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1310/2652] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/projects => generated 385 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:35.941801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.010766 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee423-e512-4673-8624-35b7cac9b60b service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.044045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.067333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.068114 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.068398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.068673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.069427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.071435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.100620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5bb95-04e0-4fd2-b5d0-c038b08fd55f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.104339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.108925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.108925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.108925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.108925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:36.167739 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.169198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.183673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1311/2653] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:36.214035 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1343/2654] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:35 2022] POST /identity/v3/users => generated 293 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:36.224058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.236069 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dd464-2462-421e-a326-ad5a68bfc74b service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.240853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.241509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.241831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.242110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.242829 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.244486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.254895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1312/2655] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:36.259037 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.269523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4694-5602-4f6c-8e09-b6d040f9d1b6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.274180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.274831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.275109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.275386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.276106 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.277692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719fe7a-088a-4cec-aaa4-e15ddcc93567 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.293033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1344/2656] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:36.293152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.304857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3e4c7-daf3-4137-a009-a5a7b5f41158 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.309705 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.310741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.311020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.311289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] PATH_INFO: `/v3/projects/a6540a84535d430a8b48c63883b4a64f/users/de4235b222a74dcea78e7d8d777d34d0/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.327337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6540a84535d430a8b48c63883b4a64f, user_id=de4235b222a74dcea78e7d8d777d34d0, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.329287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.433301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1313/2657] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:36 2022] PUT /identity/v3/projects/a6540a84535d430a8b48c63883b4a64f/users/de4235b222a74dcea78e7d8d777d34d0/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:36.442622 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:36.445049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.445330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.445604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.485627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] MFA Rules not processed for user `de4235b222a74dcea78e7d8d777d34d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:36.485627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:36.547418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1345/2658] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:36.551920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.614755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84330d13-8df8-4079-bd4f-986d0b9eaba9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.619535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.620187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.620469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.620746 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.621428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.623749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.629125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:36.735514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1314/2659] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:36 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:36.740264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.756039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aa916-08a5-45d1-99d4-7c20c5be07e5 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.814560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.815090 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.816070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.816524 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.817272 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.830579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.958550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1346/2660] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:36 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:36.962574 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:36.972878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3cf7d-0cbe-413f-9df6-8d2e8a5cb1bd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:36.977416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:36.978083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:36.978367 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:36.978644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:36.979371 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:36.981010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:36.996808 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1315/2661] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:37.006185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:37.019481 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1a812-588d-4575-b04b-a5970309629b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:37.022601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:37.023494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:37.023774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:37.024048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] PATH_INFO: `/v3/projects/2729837f2f1445728fd0cfe23d4dec4e/users/8bbde5206c3a458dbbfaac3b5ba76e99/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:37.039781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2729837f2f1445728fd0cfe23d4dec4e, user_id=8bbde5206c3a458dbbfaac3b5ba76e99, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:37.042493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:37.084183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:37.119569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1347/2662] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:37 2022] PUT /identity/v3/projects/2729837f2f1445728fd0cfe23d4dec4e/users/8bbde5206c3a458dbbfaac3b5ba76e99/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:37.123612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:37.134383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df02aef-b43f-4eb3-a9bb-4b1728e96038 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:37.193659 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:37.194363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:37.194645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:37.195003 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:37.195759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:37.197772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198866a2-8bf6-45ee-b996-7bbb4ce599b4 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:37.208750 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1316/2663] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:37.212774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:37.225278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ef09c-e118-4606-a2bf-4eb78010a14a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:37.229246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:37.230168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:37.230447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:37.230720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] PATH_INFO: `/v3/projects/2729837f2f1445728fd0cfe23d4dec4e/users/8bbde5206c3a458dbbfaac3b5ba76e99/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:37.233937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2729837f2f1445728fd0cfe23d4dec4e, user_id=8bbde5206c3a458dbbfaac3b5ba76e99, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:37.236572 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:37.254961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1348/2664] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:37 2022] PUT /identity/v3/projects/2729837f2f1445728fd0cfe23d4dec4e/users/8bbde5206c3a458dbbfaac3b5ba76e99/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:37.265422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:37.265896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:37.266260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:37.298363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] MFA Rules not processed for user `8bbde5206c3a458dbbfaac3b5ba76e99`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:37.300136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:37.372338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1317/2665] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:37.383943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:37.440307 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff8b1-aad9-44cd-b610-d59e4eafc56d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:37.443970 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:37.444611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:37.444891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:37.445166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:37.504497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:37.505897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e052d44-8b00-4ec9-a86c-cbecba8c47a5 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:37.514996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1349/2666] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:40.733477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:40.790505 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:40.796022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730670-41b9-449b-a473-b7d3111c08c7 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:40.800847 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:40.803947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:40.803947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:40.803947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] PATH_INFO: `/v3/users/9c32e954f24e4092a0079fa17c9ba6d7` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:40.803947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c32e954f24e4092a0079fa17c9ba6d7)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:40.805869 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:41.049637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c32e954f24e4092a0079fa17c9ba6d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:41.061741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c32e954f24e4092a0079fa17c9ba6d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:41.145196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c32e954f24e4092a0079fa17c9ba6d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:41.152894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c32e954f24e4092a0079fa17c9ba6d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:41.155344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c32e954f24e4092a0079fa17c9ba6d7'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:41.159620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1318/2667] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:40 2022] DELETE /identity/v3/users/9c32e954f24e4092a0079fa17c9ba6d7 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:41.164429 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:41.164894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:41.165044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:41.181861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:41.183107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:41.255224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1350/2668] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:41.265697 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:41.267784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:41.330403 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27784b7d-17b0-498e-a6f4-592b0592f204 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:41.334182 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:41.334831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:41.335170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:41.335446 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:41.345226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:41.346701 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:41.359229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1319/2669] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:41.594145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:41.595943 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:41.648091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:41.680780 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b462848-059c-4d92-bd9d-032038c79759 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:41.684588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:41.685356 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:41.685568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:41.685881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:41.687930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:41.753653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:41.755172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:41.765998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1351/2670] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:41.849879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:41.858172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:41.866253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1737fe-3ddf-426b-b72c-cbca61bff3a1 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:41.870953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:41.871822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:41.872105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:41.872377 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] PATH_INFO: `/v3/projects/9c4d6a64fca2414f8b46ebe3399c6f07` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:41.873561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c4d6a64fca2414f8b46ebe3399c6f07)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:41.875499 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:42.039683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c4d6a64fca2414f8b46ebe3399c6f07', 'request_id': 'req-e70f96a3-0dd3-4172-a547-3fe8586e7f90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.046001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c4d6a64fca2414f8b46ebe3399c6f07', 'request_id': 'req-e70f96a3-0dd3-4172-a547-3fe8586e7f90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.106857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c4d6a64fca2414f8b46ebe3399c6f07', 'request_id': 'req-e70f96a3-0dd3-4172-a547-3fe8586e7f90'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.114477 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:42.118430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] The token cache is being invalidate because project 9c4d6a64fca2414f8b46ebe3399c6f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:42.118722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.119368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.120930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1320/2671] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:41 2022] DELETE /identity/v3/projects/9c4d6a64fca2414f8b46ebe3399c6f07 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:42.125058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:42.135923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2bda4-e1bd-4f48-87d4-96a810a5b207 service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:42.191951 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:42.192816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:42.193092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:42.193363 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] PATH_INFO: `/v3/users/29dbf73a633b473aa60a8b71330406ab` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:42.194575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] RBAC: Authorizing `identity:delete_user(user_id=29dbf73a633b473aa60a8b71330406ab)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:42.196485 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:42.435126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29dbf73a633b473aa60a8b71330406ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.447897 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29dbf73a633b473aa60a8b71330406ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.527351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29dbf73a633b473aa60a8b71330406ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.527977 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29dbf73a633b473aa60a8b71330406ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.535995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29dbf73a633b473aa60a8b71330406ab'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:42.542081 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1352/2672] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:42 2022] DELETE /identity/v3/users/29dbf73a633b473aa60a8b71330406ab => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:43.148067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:43.148067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:43.148067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f96a3-0dd3-4172-a547-3fe8586e7f90 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:43.207891 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:43.208754 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:43.209033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:43.209306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] PATH_INFO: `/v3/projects/2b3f4746a30a4967b800e1e76b70fb85` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:43.210627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3f4746a30a4967b800e1e76b70fb85)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:43.212530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:43.355772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3f4746a30a4967b800e1e76b70fb85', 'request_id': 'req-20498d8b-c6d2-47ca-a99e-ba4c0531f990'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.361924 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3f4746a30a4967b800e1e76b70fb85', 'request_id': 'req-20498d8b-c6d2-47ca-a99e-ba4c0531f990'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.489935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3f4746a30a4967b800e1e76b70fb85', 'request_id': 'req-20498d8b-c6d2-47ca-a99e-ba4c0531f990'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.502752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] The token cache is being invalidate because project 2b3f4746a30a4967b800e1e76b70fb85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:43.503047 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.504143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.505710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1321/2673] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:43 2022] DELETE /identity/v3/projects/2b3f4746a30a4967b800e1e76b70fb85 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:43.509884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:43.511314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:43.525667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7fb431-c3b2-416c-9cd0-cba6f5ee377f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:43.533841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:43.587423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:43.588821 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:43.589119 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:43.589599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] PATH_INFO: `/v3/users/e095e451b1484b7aa52eb4a2e9675dd1` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:43.591232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e095e451b1484b7aa52eb4a2e9675dd1)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:43.593207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:43.713645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:43.715156 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:43.776130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20498d8b-c6d2-47ca-a99e-ba4c0531f990 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:43.779895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:43.780569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:43.780850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:43.781130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:43.782943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:43.829423 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:43.849352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:43.850415 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e095e451b1484b7aa52eb4a2e9675dd1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.850825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:43.860890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1322/2674] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:43.865302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e095e451b1484b7aa52eb4a2e9675dd1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.923984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e095e451b1484b7aa52eb4a2e9675dd1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.925333 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e095e451b1484b7aa52eb4a2e9675dd1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.945068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-41482f74-bbf5-4187-b741-5b513639a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e095e451b1484b7aa52eb4a2e9675dd1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:43.956721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1353/2675] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:43 2022] DELETE /identity/v3/users/e095e451b1484b7aa52eb4a2e9675dd1 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:44.458483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:44.459959 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:44.474168 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13564250-1a84-4055-9ddb-cb664a27e60e service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:44.543479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:44.544365 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:44.544651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:44.544929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] PATH_INFO: `/v3/projects/157c4b292c244a88bd0cf778b17cd700` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:44.546174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] RBAC: Authorizing `identity:delete_project(project_id=157c4b292c244a88bd0cf778b17cd700)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:44.548038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:44.699581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '157c4b292c244a88bd0cf778b17cd700', 'request_id': 'req-9d60a26c-9398-4f2d-881f-7d2ea277237a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:44.706546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '157c4b292c244a88bd0cf778b17cd700', 'request_id': 'req-9d60a26c-9398-4f2d-881f-7d2ea277237a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:44.797728 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '157c4b292c244a88bd0cf778b17cd700', 'request_id': 'req-9d60a26c-9398-4f2d-881f-7d2ea277237a'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:44.809095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] The token cache is being invalidate because project 157c4b292c244a88bd0cf778b17cd700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:44.809383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:44.810021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9d60a26c-9398-4f2d-881f-7d2ea277237a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:44.811573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1323/2676] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:44 2022] DELETE /identity/v3/projects/157c4b292c244a88bd0cf778b17cd700 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:44.820230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:44.820717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:44.820826 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:44.841507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:44.842857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:44.902456 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1354/2677] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:28:44.911286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:44.911569 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:44.911841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:44.930237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:44.938512 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:44.939343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1324/2678] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:44.944040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:44.954183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c63f91-f243-4f61-aaa3-a641168d47dd None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:44.959556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:44.960216 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:44.960496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:44.960775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:44.961659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:44.967116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:44.967116 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:44.976038 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1355/2679] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:44.980729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:44.992910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9534be-52b6-40f4-8d8b-58e9d6d9cefe None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:44.997649 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:44.998340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:44.998615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:44.998889 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:44.999607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.001558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.102549 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1325/2680] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:44 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:45.107077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.118841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb38974-a6c3-4663-b0e3-b18ecc57f395 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.134052 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:45.184996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.185896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.186139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.186490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.187121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.189093 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.308220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1356/2681] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:45 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:45.309755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.321103 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac96b2-3412-4732-bfa2-ae8bb50f8fae admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.326107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.328083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.328083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.328083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.328083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.329646 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.342093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1326/2682] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:45.346248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.356161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08234826-eb3a-4925-96e3-6d943dbb3d08 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.360858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.361518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.362458 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.362604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.363330 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.364918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b690b-da64-4090-8dcc-537b01addb3c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.376055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1357/2683] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:45.380528 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.390689 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f709c-2633-44df-9d21-2252ab95ed60 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.396181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.397064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.403064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.403064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] PATH_INFO: `/v3/projects/f2ae6e1a2f504d5ab859ad9f4aee77fa/users/e1e93ec6a12f49f593503f93cb34fcba/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.414498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ae6e1a2f504d5ab859ad9f4aee77fa, user_id=e1e93ec6a12f49f593503f93cb34fcba, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.417158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.541252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1327/2684] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:45 2022] PUT /identity/v3/projects/f2ae6e1a2f504d5ab859ad9f4aee77fa/users/e1e93ec6a12f49f593503f93cb34fcba/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:45.552357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.552745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.553095 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.582033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] MFA Rules not processed for user `e1e93ec6a12f49f593503f93cb34fcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:45.583255 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:45.651124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1358/2685] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:45.662602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.664449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:45.674929 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:45.722127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d0233-dced-4ae9-8b94-466783259166 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.725806 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.726685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.726943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.727223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.735994 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.737469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc43559-a454-48ee-bad6-3276c46cf9e9 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.746357 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1328/2686] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:45.766739 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:45.830284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9896f7-4202-4fd1-9fe3-c23948b004b8 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:45.834933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:45.835792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:45.836073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:45.836353 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] PATH_INFO: `/v3/users/e1e93ec6a12f49f593503f93cb34fcba` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:45.837560 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e93ec6a12f49f593503f93cb34fcba)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:45.839556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:45.948620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:46.086444 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e93ec6a12f49f593503f93cb34fcba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:46.098375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e93ec6a12f49f593503f93cb34fcba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:46.173171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e93ec6a12f49f593503f93cb34fcba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:46.173818 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e93ec6a12f49f593503f93cb34fcba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:46.183061 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e93ec6a12f49f593503f93cb34fcba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:46.189805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1359/2687] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:45 2022] DELETE /identity/v3/users/e1e93ec6a12f49f593503f93cb34fcba => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:46.194962 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:46.195252 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:46.195538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:46.214614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:46.215824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:46.276591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1329/2688] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:46.286253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:46.287667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:46.344857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f2a9-d2e9-425d-8faf-e60163607664 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:46.348483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:46.349129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:46.349406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:46.349775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:46.359366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:46.360786 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89a460-1e8c-46ed-b7fe-4e27be444d6c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:46.370455 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1360/2689] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:46.846637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:46.848661 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:46.861116 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b7abd-9819-460e-8358-17e5ce1417c2 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:46.866576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:46.867662 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:46.868124 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:46.868552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] PATH_INFO: `/v3/projects/f2ae6e1a2f504d5ab859ad9f4aee77fa` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:46.871831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ae6e1a2f504d5ab859ad9f4aee77fa)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:46.873777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.008802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ae6e1a2f504d5ab859ad9f4aee77fa', 'request_id': 'req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:47.016988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ae6e1a2f504d5ab859ad9f4aee77fa', 'request_id': 'req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:47.106780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ae6e1a2f504d5ab859ad9f4aee77fa', 'request_id': 'req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:47.118127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] The token cache is being invalidate because project f2ae6e1a2f504d5ab859ad9f4aee77fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:47.118416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:47.119049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5afbd94d-5458-4109-9e77-1c4d0d8b70bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:47.120726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1330/2690] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:46 2022] DELETE /identity/v3/projects/f2ae6e1a2f504d5ab859ad9f4aee77fa => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:47.125606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.126105 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.126201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.144868 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:47.146620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:47.220567 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1361/2691] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:47.232672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.232672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.232672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.251885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:47.253607 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:47.261821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1331/2692] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:47.266649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.277135 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f55a1a3-d907-4a2c-9fd2-b351946736e2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.281751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.282422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.282690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.282967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.283775 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:47.284071 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.285673 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.301305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1362/2693] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:47.305817 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.318483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec92564-4f4f-4127-9339-055566194c62 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.325136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.325825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.326767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.327068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.327782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.329682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.393809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1332/2694] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:47 2022] POST /identity/v3/projects => generated 371 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:47.394956 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.405621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35973cb-ebeb-41cc-9f38-d7b9afaf4a4a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.441935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:47.468891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.468891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.468891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.469253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.469706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.472244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.573579 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1363/2695] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:47 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:47.577676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.589594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:47.603121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d02eac-b26d-40b0-be05-de03dbed193c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.603121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.603121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.603438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.603538 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.604261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.605873 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.621081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1333/2696] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:47.625302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.635967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc77aa-31ce-4bc4-b75b-5fc90cf50282 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.641183 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.641949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.642237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.642639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.643896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.645518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a603e5-10d1-4d61-9c46-2ad22b34c08f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.658158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1364/2697] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:47.667302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.679172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805016ef-e462-479b-a1f2-293df77b5542 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:47.684644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:47.685669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.685985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.686259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] PATH_INFO: `/v3/projects/652063d3ab3d4adc84378e714a0c6ec1/users/7ef8580c9f9d4dc7844a4536da25b9ce/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.701922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] RBAC: Authorizing `identity:create_grant(project_id=652063d3ab3d4adc84378e714a0c6ec1, user_id=7ef8580c9f9d4dc7844a4536da25b9ce, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:47.704541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:47.809894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1334/2698] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:47 2022] PUT /identity/v3/projects/652063d3ab3d4adc84378e714a0c6ec1/users/7ef8580c9f9d4dc7844a4536da25b9ce/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:47.876443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:47.876738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:47.877148 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:47.907069 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] MFA Rules not processed for user `7ef8580c9f9d4dc7844a4536da25b9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:47.908290 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:47.978599 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1365/2699] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:47.989680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:47.991779 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:48.049131 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f0280-fd9b-4a41-86af-b49a335a031a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:48.053343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:48.054088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:48.054372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:48.054648 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:48.063261 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:48.064564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698315d1-814c-4d34-a6bc-090e44521acd service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:48.074346 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1335/2700] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:48.728029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:48.729507 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:48.799155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f6b09-3268-49de-94c6-80a639d591ff None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:48.804793 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:48.805691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:48.805991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:48.806266 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] PATH_INFO: `/v3/users/81bee0810816412fb20a6d8e710ea0ba` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:48.807451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81bee0810816412fb20a6d8e710ea0ba)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:48.809497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:49.022127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:49.023669 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81bee0810816412fb20a6d8e710ea0ba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.035594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81bee0810816412fb20a6d8e710ea0ba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.112117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81bee0810816412fb20a6d8e710ea0ba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.113237 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81bee0810816412fb20a6d8e710ea0ba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.120852 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81bee0810816412fb20a6d8e710ea0ba'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.126787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1366/2701] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:48 2022] DELETE /identity/v3/users/81bee0810816412fb20a6d8e710ea0ba => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:49.131899 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:49.132408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:49.132514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:49.149343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:49.150576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:49.209093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1336/2702] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:49.218768 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:49.220175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:49.278303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aec075-8bfb-4448-bda7-97c3befd78a5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:49.282175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:49.282843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:49.283144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:49.283417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:49.293132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:49.294600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8406a139-e1d3-4037-9fc9-f5ba0e0b2c44 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:49.304645 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1367/2703] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:49.754558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:49.754863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:49.770841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f59ec-c29a-40b1-9fcf-949dd8fafcdc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:49.776464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:49.777363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:49.777849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:49.778725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] PATH_INFO: `/v3/projects/9731237b2c5b4e61a73f5ed5cda43161` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:49.784874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9731237b2c5b4e61a73f5ed5cda43161)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:49.784874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:49.876875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:49.877390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:49.877489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:49.895366 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] MFA Rules not processed for user `7ef8580c9f9d4dc7844a4536da25b9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:49.896577 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:49.925813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9731237b2c5b4e61a73f5ed5cda43161', 'request_id': 'req-b13f13a7-371b-43e1-81d0-15aaba19710c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.932158 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9731237b2c5b4e61a73f5ed5cda43161', 'request_id': 'req-b13f13a7-371b-43e1-81d0-15aaba19710c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:49.958832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1368/2704] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:49.995174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:49.996586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.053822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9731237b2c5b4e61a73f5ed5cda43161', 'request_id': 'req-b13f13a7-371b-43e1-81d0-15aaba19710c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.060232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:50.066385 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d4d77-39ae-403f-a4a0-714515a0e1ce None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:50.067695 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] The token cache is being invalidate because project 9731237b2c5b4e61a73f5ed5cda43161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:50.068095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.068954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.070665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1337/2705] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:49 2022] DELETE /identity/v3/projects/9731237b2c5b4e61a73f5ed5cda43161 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:50.077225 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:50.078652 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.093492 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:50.123143 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53da70e1f5bf46ec924902edf423ca91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:50.124171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:50.124667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:50.125186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:50.127973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.155434 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f13a7-371b-43e1-81d0-15aaba19710c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:50.161165 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:50.162073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:50.162356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:50.162629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] PATH_INFO: `/v3/users/de4235b222a74dcea78e7d8d777d34d0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:50.163850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4235b222a74dcea78e7d8d777d34d0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:50.165834 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:50.203510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:50.204873 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:50.216293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1369/2706] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:28:50.390034 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4235b222a74dcea78e7d8d777d34d0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.401595 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4235b222a74dcea78e7d8d777d34d0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.455286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4235b222a74dcea78e7d8d777d34d0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.463311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4235b222a74dcea78e7d8d777d34d0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.464521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4235b222a74dcea78e7d8d777d34d0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:50.471016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1338/2707] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:50 2022] DELETE /identity/v3/users/de4235b222a74dcea78e7d8d777d34d0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:50.812129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:50.812129 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.883958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc772e-5a2a-44ca-8987-5cd9c8942638 service glance] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:50.899599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:50.899599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.948389 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:50.950511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:50.950511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:50.950511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:50.951907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:50.975267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec338926-8bb2-49e5-974c-88189f17fac6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:50.979956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:50.980811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:50.981088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:50.981364 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] PATH_INFO: `/v3/projects/a6540a84535d430a8b48c63883b4a64f` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:50.982551 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6540a84535d430a8b48c63883b4a64f)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:50.984640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:51.026463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:51.027817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:51.039375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1370/2708] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:28:51.163792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6540a84535d430a8b48c63883b4a64f', 'request_id': 'req-1fd97ecd-8aee-4c29-9d11-03723b28a840'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.169948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6540a84535d430a8b48c63883b4a64f', 'request_id': 'req-1fd97ecd-8aee-4c29-9d11-03723b28a840'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.266530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6540a84535d430a8b48c63883b4a64f', 'request_id': 'req-1fd97ecd-8aee-4c29-9d11-03723b28a840'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.278636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] The token cache is being invalidate because project a6540a84535d430a8b48c63883b4a64f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:51.278852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.279520 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.281095 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1339/2709] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:50 2022] DELETE /identity/v3/projects/a6540a84535d430a8b48c63883b4a64f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:51.285941 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:51.300007 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72389b9f-8bcf-4d54-b26a-1c1e36b1d617 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:51.357711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:51.358604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:51.358875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:51.359170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] PATH_INFO: `/v3/users/8bbde5206c3a458dbbfaac3b5ba76e99` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:51.360327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbde5206c3a458dbbfaac3b5ba76e99)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:51.362408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:51.410300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:51.565934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbde5206c3a458dbbfaac3b5ba76e99'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.578123 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbde5206c3a458dbbfaac3b5ba76e99'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.582465 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:51.683314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbde5206c3a458dbbfaac3b5ba76e99'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.683935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbde5206c3a458dbbfaac3b5ba76e99'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.691710 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-7824dc08-3c41-4ad7-9aa9-793a0b4b0dae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbde5206c3a458dbbfaac3b5ba76e99'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:51.698134 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1371/2710] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:28:51 2022] DELETE /identity/v3/users/8bbde5206c3a458dbbfaac3b5ba76e99 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:52.110167 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:52.112166 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:52.143476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd97ecd-8aee-4c29-9d11-03723b28a840 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:52.214057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:52.214957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.215215 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.215489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] PATH_INFO: `/v3/projects/2729837f2f1445728fd0cfe23d4dec4e` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.216717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2729837f2f1445728fd0cfe23d4dec4e)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:52.218680 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:52.361489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2729837f2f1445728fd0cfe23d4dec4e', 'request_id': 'req-22778c5f-f7d6-43ff-a138-3febbcffde50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:52.368271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2729837f2f1445728fd0cfe23d4dec4e', 'request_id': 'req-22778c5f-f7d6-43ff-a138-3febbcffde50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:52.473435 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2729837f2f1445728fd0cfe23d4dec4e', 'request_id': 'req-22778c5f-f7d6-43ff-a138-3febbcffde50'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:52.487037 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] The token cache is being invalidate because project 2729837f2f1445728fd0cfe23d4dec4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:28:52.487328 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:52.488109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-22778c5f-f7d6-43ff-a138-3febbcffde50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:28:52.489786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1340/2711] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:28:52 2022] DELETE /identity/v3/projects/2729837f2f1445728fd0cfe23d4dec4e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:28:52.494937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.495745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.496023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.514947 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:52.516172 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:52.559854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:52.579161 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1372/2712] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:52.588594 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.588890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.589243 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.607654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:52.608868 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:52.617627 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1341/2713] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:52.621811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:52.632051 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a91442-db0b-4af5-a656-95d48f47e892 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:52.636909 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:52.637575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.637896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.638173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.638901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:28:52.639207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:52.640845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:52.653519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1373/2714] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:28:52.657267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:52.666570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983135c2-abe3-4a84-876e-53746f09e518 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:52.671464 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:52.672109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.672394 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.672672 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.673368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:52.675840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:52.760349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1342/2715] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:28:52 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:28:52.764522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:52.774552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8801d1a6-b2b3-4433-89d3-5029853b9166 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:52.832025 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:52.832605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.832937 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.833110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.833832 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:52.835788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:52.969806 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1374/2716] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:28:52 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:28:52.973670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:52.983972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30ee725-4515-4ffe-bd30-47da460e42cd admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:52.988615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:52.989280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:52.989554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:52.989863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:52.990593 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:52.992202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:52.993668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:28:53.004581 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1343/2717] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:53.021711 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:53.031933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34a128-2790-4901-ae30-08409adcf2b6 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:53.036544 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:53.037196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:53.037480 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:53.037781 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:53.038514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:53.040132 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b0064-7692-4a52-b1c0-195d7b338f14 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:53.050162 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1375/2718] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:28:53.054374 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:53.064321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a810a3-afce-4d7a-880d-c2452d4e3d71 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:53.075591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:53.075591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:53.075591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:53.075591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] PATH_INFO: `/v3/projects/d09a6e7c72fc417c957fbd3aacc37ffd/users/f4925f91ae634b3da67266f25a297552/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:53.086019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09a6e7c72fc417c957fbd3aacc37ffd, user_id=f4925f91ae634b3da67266f25a297552, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:53.088657 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:53.281881 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1344/2719] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:28:53 2022] PUT /identity/v3/projects/d09a6e7c72fc417c957fbd3aacc37ffd/users/f4925f91ae634b3da67266f25a297552/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:28:53.292222 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:53.292518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:53.292802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:53.331695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] MFA Rules not processed for user `f4925f91ae634b3da67266f25a297552`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:28:53.332928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:53.416147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1376/2720] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:28:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:28:53.428316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:28:53.430465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:28:53.504608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594b7a-a0aa-4048-a61b-88a19120e13b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:28:53.508985 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:28:53.509626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:28:53.509953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:28:53.510233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:28:53.519591 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:28:53.521052 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62663e-c03c-44e3-aacf-ed381a38e863 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:28:53.533568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1345/2721] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:28:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:03.889525 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=79,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:03.990262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=38,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:05.021582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:05.085469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afc35c-9aa7-4bc2-9733-04152d88e796 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:05.094626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:05.094626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:05.094626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:05.094626 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] PATH_INFO: `/v3/users/f4925f91ae634b3da67266f25a297552` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:05.095017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4925f91ae634b3da67266f25a297552)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:05.095017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:05.327576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4925f91ae634b3da67266f25a297552'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:05.341048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4925f91ae634b3da67266f25a297552'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:05.409489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4925f91ae634b3da67266f25a297552'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:05.410200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4925f91ae634b3da67266f25a297552'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:05.418419 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4925f91ae634b3da67266f25a297552'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:05.424373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1377/2722] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:05 2022] DELETE /identity/v3/users/f4925f91ae634b3da67266f25a297552 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:29:05.429198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:05.429685 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:05.429865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:05.448397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:05.449630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:05.510451 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1346/2723] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:05.519921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:05.521351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:05.584504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09aae5-46fb-4a87-9a81-6f969482193f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:05.588759 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:05.589548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:05.589841 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:05.590117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:05.599911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:05.601983 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:05.613170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1378/2724] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:06.197519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:06.199148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:06.212523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0cd66-6a58-4c3f-9a5f-4d5a0d184952 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:06.217325 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:06.218265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:06.218545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:06.218815 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] PATH_INFO: `/v3/projects/d09a6e7c72fc417c957fbd3aacc37ffd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:06.220022 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09a6e7c72fc417c957fbd3aacc37ffd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:06.221989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:06.346081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09a6e7c72fc417c957fbd3aacc37ffd', 'request_id': 'req-797ec0be-21da-4386-a221-6697a434aace'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:06.352819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09a6e7c72fc417c957fbd3aacc37ffd', 'request_id': 'req-797ec0be-21da-4386-a221-6697a434aace'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:06.361965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:06.371285 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94b416-6d04-4a6f-b64b-5e4483c78f02 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:06.389595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:06.421147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:06.421838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:06.422122 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:06.422397 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:06.424338 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:06.431326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09a6e7c72fc417c957fbd3aacc37ffd', 'request_id': 'req-797ec0be-21da-4386-a221-6697a434aace'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:06.434633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:06.436094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6c9fe-927a-41bd-aed5-d91d8706aca7 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:06.442397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] The token cache is being invalidate because project d09a6e7c72fc417c957fbd3aacc37ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:06.446306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:06.446306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:06.446815 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1379/2725] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:29:06.446922 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1347/2726] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:06 2022] DELETE /identity/v3/projects/d09a6e7c72fc417c957fbd3aacc37ffd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:09.803935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd848bd-f510-4a84-8cd2-760d16ab8af1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:09.807022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd848bd-f510-4a84-8cd2-760d16ab8af1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:09.807022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd848bd-f510-4a84-8cd2-760d16ab8af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:09.831158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-4dd848bd-f510-4a84-8cd2-760d16ab8af1 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:09.832373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4dd848bd-f510-4a84-8cd2-760d16ab8af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:09.907327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1380/2727] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:29:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:09.948783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:09.950259 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:10.019221 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ec0be-21da-4386-a221-6697a434aace admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:10.024660 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:10.025813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:10.026101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:10.026381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:10.035384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:10.036978 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:10.045244 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1348/2728] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:29:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:29:11.063205 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510139-91a9-4d5e-bfc9-c7ce3ae42799 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:11.063692 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510139-91a9-4d5e-bfc9-c7ce3ae42799 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:11.063802 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3510139-91a9-4d5e-bfc9-c7ce3ae42799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:11.082654 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-d3510139-91a9-4d5e-bfc9-c7ce3ae42799 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:11.083881 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d3510139-91a9-4d5e-bfc9-c7ce3ae42799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:11.091905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1381/2729] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:11.105890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:11.116018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edb20c8-0113-4761-bcc6-8168087bcd68 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:11.121927 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:11.122567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:11.122849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:11.123129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:11.131717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:11.133281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:11.138795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:11.142905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1349/2730] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:29:11.848611 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a92-2ce6-4001-906b-9cac7b97a6b1 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:11.848901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a92-2ce6-4001-906b-9cac7b97a6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:11.849182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32079a92-2ce6-4001-906b-9cac7b97a6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:11.879091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-32079a92-2ce6-4001-906b-9cac7b97a6b1 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:11.880335 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-32079a92-2ce6-4001-906b-9cac7b97a6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:11.889233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1382/2731] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:29:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:11.901987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:11.912943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd81d4-27cc-47a6-ad49-71af88f1c145 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:11.918147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:11.918787 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:11.919068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:11.919345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:11.927906 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:11.929471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:11.938826 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1350/2732] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:29:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:29:12.629295 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:12.629796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:12.629882 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:12.648632 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:12.649870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:12.657681 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1383/2733] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:29:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:12.670428 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:12.681024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a043ed1-d98b-4442-96a8-1faba153d027 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:12.686133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:12.686683 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:12.686963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:12.687265 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:12.695355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:12.699155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f361325-50c2-481f-b948-c8df7fd8ba8b service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:12.705465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1351/2734] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:29:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:29:13.115610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:13.117097 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:13.201699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d99bf-4386-4a0b-8411-6fdbb7a5edf4 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:13.207462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:13.208324 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:13.208613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:13.208896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] PATH_INFO: `/v3/users/146beff435104ea4aca9402ca5c5a349` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:13.210483 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=146beff435104ea4aca9402ca5c5a349)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:13.213265 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:13.446906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '146beff435104ea4aca9402ca5c5a349'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:13.452251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:13.460435 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '146beff435104ea4aca9402ca5c5a349'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:13.579894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '146beff435104ea4aca9402ca5c5a349'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:13.580451 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '146beff435104ea4aca9402ca5c5a349'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:13.587994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '146beff435104ea4aca9402ca5c5a349'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:13.594306 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1384/2735] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:13 2022] DELETE /identity/v3/users/146beff435104ea4aca9402ca5c5a349 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:13.598810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:13.599101 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:13.599456 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:13.616784 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:13.618039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:13.686206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1352/2736] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:13.700269 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:13.701749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:13.764373 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b70545-5cfb-4c25-a8e7-51a343e65c69 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:13.768142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:13.768792 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:13.769072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:13.769347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:13.779495 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:13.780986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:13.791277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1385/2737] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:29:14.280120 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:14.285266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:14.300201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3298-988e-4917-bff7-fa6075c01acc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:14.315470 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:14.317355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:14.318698 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:14.319457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] PATH_INFO: `/v3/projects/fe57d73a1e6c4645bdabef43c87ebc7c` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:14.322559 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe57d73a1e6c4645bdabef43c87ebc7c)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:14.326432 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:14.485916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe57d73a1e6c4645bdabef43c87ebc7c', 'request_id': 'req-9f54c25c-729b-400c-896e-4bbf827cb171'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.492406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe57d73a1e6c4645bdabef43c87ebc7c', 'request_id': 'req-9f54c25c-729b-400c-896e-4bbf827cb171'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.568458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe57d73a1e6c4645bdabef43c87ebc7c', 'request_id': 'req-9f54c25c-729b-400c-896e-4bbf827cb171'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.583726 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] The token cache is being invalidate because project fe57d73a1e6c4645bdabef43c87ebc7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:14.584016 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.584686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.586640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1353/2738] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:14 2022] DELETE /identity/v3/projects/fe57d73a1e6c4645bdabef43c87ebc7c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:14.590872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:14.604086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7782636e-9e9d-4af7-bb2e-a2cedfad2097 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:14.660889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:14.661905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:14.662191 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:14.662484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] PATH_INFO: `/v3/users/b0e5d387a7ac42e6b78404708b0b11ed` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:14.663682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e5d387a7ac42e6b78404708b0b11ed)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:14.665615 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:14.885990 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e5d387a7ac42e6b78404708b0b11ed'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:14.898058 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e5d387a7ac42e6b78404708b0b11ed'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.014101 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e5d387a7ac42e6b78404708b0b11ed'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.014730 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e5d387a7ac42e6b78404708b0b11ed'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.017118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:15.022543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e5d387a7ac42e6b78404708b0b11ed'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.029055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1386/2739] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:14 2022] DELETE /identity/v3/users/b0e5d387a7ac42e6b78404708b0b11ed => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:15.477286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:15.478768 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:15.499248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54c25c-729b-400c-896e-4bbf827cb171 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:15.552813 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:15.553530 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:15.562058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:15.569677 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:15.570730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.571380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.571767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] PATH_INFO: `/v3/projects/00e7833f4ed84961aea0a278ee877913` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.573150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e7833f4ed84961aea0a278ee877913)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:15.575809 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:15.633680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548235f0-5973-425e-8c36-d19608ba2e32 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:15.639601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:15.640517 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.640796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.641072 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] PATH_INFO: `/v3/users/7ef8580c9f9d4dc7844a4536da25b9ce` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.642297 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef8580c9f9d4dc7844a4536da25b9ce)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:15.644244 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:15.683489 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e7833f4ed84961aea0a278ee877913', 'request_id': 'req-507353e3-c84c-4a7b-a48f-bbc277d64807'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.690249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e7833f4ed84961aea0a278ee877913', 'request_id': 'req-507353e3-c84c-4a7b-a48f-bbc277d64807'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.780552 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e7833f4ed84961aea0a278ee877913', 'request_id': 'req-507353e3-c84c-4a7b-a48f-bbc277d64807'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.791430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] The token cache is being invalidate because project 00e7833f4ed84961aea0a278ee877913 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:15.791718 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.792344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-507353e3-c84c-4a7b-a48f-bbc277d64807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.793935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1354/2740] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:15 2022] DELETE /identity/v3/projects/00e7833f4ed84961aea0a278ee877913 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:15.798654 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79169-fbfa-4aa4-bdeb-d473ed4e28d4 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.798939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79169-fbfa-4aa4-bdeb-d473ed4e28d4 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.799218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e79169-fbfa-4aa4-bdeb-d473ed4e28d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.817455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-17e79169-fbfa-4aa4-bdeb-d473ed4e28d4 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:15.818759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17e79169-fbfa-4aa4-bdeb-d473ed4e28d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:15.851516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef8580c9f9d4dc7844a4536da25b9ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.864364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef8580c9f9d4dc7844a4536da25b9ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.878908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1355/2741] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:15.886587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.886900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.887189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.905503 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:15.906752 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:15.914777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1356/2742] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:15.919326 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:15.928445 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc19100-e291-4c1f-90bf-97963697e438 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:15.933281 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:15.933969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.934251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.935118 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.935833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:29:15.936140 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:15.937757 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:15.945536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef8580c9f9d4dc7844a4536da25b9ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.946713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef8580c9f9d4dc7844a4536da25b9ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.949988 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1357/2743] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:29:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:29:15.954749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:15.954919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-383f6607-5b0a-48f9-833d-7d232a2d1a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef8580c9f9d4dc7844a4536da25b9ce'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:15.956612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:15.960978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1387/2744] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:15 2022] DELETE /identity/v3/users/7ef8580c9f9d4dc7844a4536da25b9ce => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:15.966523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:15.966963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:15.967358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:15.972612 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa3465-04aa-48cd-9b95-f9328c1ff82d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:15.989155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:15.991343 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:16.034301 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.034973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.035337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.035686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.036436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.038475 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.051440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1388/2745] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:16.052362 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:16.061772 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.063196 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:16.076656 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:16.120199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a85eb9-b185-40bb-8655-17dff148c654 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.124612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.125254 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.125540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.125853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.135218 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.136646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.146210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1389/2746] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:29:16.158686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1358/2747] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:15 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:16.162946 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.173628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c07d01-1c2c-4de5-b4a5-92ad01f2d757 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.238342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.239027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.239309 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.239595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.240282 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.242243 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.334630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1390/2748] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:16 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:16.338721 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.350272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3362ddd8-fba0-4371-919b-c56d4903426d admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.354956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.355599 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.355879 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.356153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.357541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.359185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.369708 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1359/2749] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:16.378552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.388936 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ddb6d-f5de-48fa-818d-2496bd3e9483 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.393639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.402765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.402765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.402765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.402765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.402765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.406287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.408129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:16.410432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1391/2750] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:16.414486 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.423350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad93e07-3494-453d-b1aa-af1f8b497b0e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.426337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce7fe05-405f-49c7-97a3-e11df181f465 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.428472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.429522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.430018 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.430297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] PATH_INFO: `/v3/projects/652063d3ab3d4adc84378e714a0c6ec1` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.431562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=652063d3ab3d4adc84378e714a0c6ec1)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.433102 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.433443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.434109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.434475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.434697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] PATH_INFO: `/v3/projects/ecbc8ab1ebb54b038af4d605802fdf1f/users/1e1d2a3aeb2b4966bc4e32af0e6703ff/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.453121 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbc8ab1ebb54b038af4d605802fdf1f, user_id=1e1d2a3aeb2b4966bc4e32af0e6703ff, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.455886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bc8ec-cf32-4b80-bd6a-126f3d421853 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.552706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1392/2751] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:16 2022] PUT /identity/v3/projects/ecbc8ab1ebb54b038af4d605802fdf1f/users/1e1d2a3aeb2b4966bc4e32af0e6703ff/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:16.563976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.564261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.564471 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652063d3ab3d4adc84378e714a0c6ec1', 'request_id': 'req-8d26c737-9592-4133-815f-9b38d3a04ada'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:16.564929 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.571613 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652063d3ab3d4adc84378e714a0c6ec1', 'request_id': 'req-8d26c737-9592-4133-815f-9b38d3a04ada'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:16.591853 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] MFA Rules not processed for user `1e1d2a3aeb2b4966bc4e32af0e6703ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:16.592976 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:16.636824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652063d3ab3d4adc84378e714a0c6ec1', 'request_id': 'req-8d26c737-9592-4133-815f-9b38d3a04ada'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:16.649429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] The token cache is being invalidate because project 652063d3ab3d4adc84378e714a0c6ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:16.649710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:16.650376 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:16.652092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:16.652422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1360/2752] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:16 2022] DELETE /identity/v3/projects/652063d3ab3d4adc84378e714a0c6ec1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:29:16.663879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1393/2753] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:16.668895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.670460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:16.752934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26c737-9592-4133-815f-9b38d3a04ada admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.758001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.758686 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.758971 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.759246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.759947 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.761910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:16.855251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1361/2754] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:16 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:16.859352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:16.870751 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858f3c5-9539-41fa-9173-96c54435ec32 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:16.933091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:16.933785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:16.934067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:16.934347 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:16.935168 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:16.937100 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.008695 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1394/2755] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:16 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:17.013323 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:17.024038 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d603d-0148-4c86-8bc6-9df7fc740f34 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:17.029231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:17.029950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.030239 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.030513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.031232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:17.032814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.043321 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1362/2756] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:17.047474 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:17.057457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371be48-5867-4261-b342-b02c38565b2b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:17.062666 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:17.063809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.063809 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.064084 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] PATH_INFO: `/v3/projects/cea13e96e46d4f34a31ca995c50106f4/users/1f4047b5c941489baf471056d37cedf0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.079565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea13e96e46d4f34a31ca995c50106f4, user_id=1f4047b5c941489baf471056d37cedf0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:17.082251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.151523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1395/2757] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:17 2022] PUT /identity/v3/projects/cea13e96e46d4f34a31ca995c50106f4/users/1f4047b5c941489baf471056d37cedf0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:17.155491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:17.165494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566bf28-b326-4a3b-ba77-174d750d4aec admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:17.203618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:17.222143 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:17.222823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.223177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.223460 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.224275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:17.226076 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb58f4e-d0ae-4b29-bacf-2f644f553dc7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.236545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1363/2758] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:17.240475 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:17.251720 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff84dd4-77f2-4d3a-95ef-d8a6d0649fe7 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:17.256447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:17.257318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.257646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.257911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] PATH_INFO: `/v3/projects/cea13e96e46d4f34a31ca995c50106f4/users/1f4047b5c941489baf471056d37cedf0/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.259924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea13e96e46d4f34a31ca995c50106f4, user_id=1f4047b5c941489baf471056d37cedf0, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:17.263247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.273699 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1396/2759] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:17 2022] PUT /identity/v3/projects/cea13e96e46d4f34a31ca995c50106f4/users/1f4047b5c941489baf471056d37cedf0/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:17.283864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.284159 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.284542 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.311901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] MFA Rules not processed for user `1f4047b5c941489baf471056d37cedf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:17.313111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:17.380772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1364/2760] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:17.392687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:17.394595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:17.452298 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7bf89f-9872-461d-bcc9-c21c0d1e8f9c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:17.455861 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:17.456494 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:17.456770 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:17.457041 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:17.465848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:17.467260 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2952af3-3c0a-4e86-8933-31e0b4ea04a9 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:17.476591 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1397/2761] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:17 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:18.414062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:18.477546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5e1dc-1d7b-4152-8884-3b509355132a None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:18.482200 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:18.483062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:18.483339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:18.483611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] PATH_INFO: `/v3/users/1e1d2a3aeb2b4966bc4e32af0e6703ff` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:18.484780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1d2a3aeb2b4966bc4e32af0e6703ff)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:18.486716 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:18.720313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1d2a3aeb2b4966bc4e32af0e6703ff'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:18.731274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:18.733274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1d2a3aeb2b4966bc4e32af0e6703ff'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:18.808307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1d2a3aeb2b4966bc4e32af0e6703ff'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:18.816833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1d2a3aeb2b4966bc4e32af0e6703ff'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:18.817391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1d2a3aeb2b4966bc4e32af0e6703ff'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:18.823635 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1365/2762] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:18 2022] DELETE /identity/v3/users/1e1d2a3aeb2b4966bc4e32af0e6703ff => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:29:18.828198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:18.828691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:18.828790 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:18.847190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:18.848355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:18.901508 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:18.913978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1398/2763] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:18.923553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:18.924966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:18.982575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54477fa-9d9c-4a3e-b184-63c6961a92e3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:18.986584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:18.987345 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:18.987736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:18.988128 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:18.998533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:18.999586 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:19.009730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1366/2764] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:19.467045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:19.468466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:19.481023 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2041dd42-1faa-4d35-827e-d016deed06da None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:19.485774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:19.486649 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:19.486923 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:19.487193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] PATH_INFO: `/v3/projects/ecbc8ab1ebb54b038af4d605802fdf1f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:19.488377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbc8ab1ebb54b038af4d605802fdf1f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:19.490421 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:19.638390 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbc8ab1ebb54b038af4d605802fdf1f', 'request_id': 'req-e3eeeaaa-f93a-4f72-898a-eac4045ed211'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:19.644595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbc8ab1ebb54b038af4d605802fdf1f', 'request_id': 'req-e3eeeaaa-f93a-4f72-898a-eac4045ed211'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:19.651344 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbc8ab1ebb54b038af4d605802fdf1f', 'request_id': 'req-e3eeeaaa-f93a-4f72-898a-eac4045ed211'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:19.739158 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] The token cache is being invalidate because project ecbc8ab1ebb54b038af4d605802fdf1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:19.739445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:19.740068 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:19.745883 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1399/2765] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:19 2022] DELETE /identity/v3/projects/ecbc8ab1ebb54b038af4d605802fdf1f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:19.746049 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:19.756092 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e81b9-a007-4593-a0a2-8ef773e516ff service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:19.812483 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:19.813350 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:19.813631 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:19.813941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] PATH_INFO: `/v3/users/1f4047b5c941489baf471056d37cedf0` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:19.815127 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4047b5c941489baf471056d37cedf0)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:19.817079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:20.102925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4047b5c941489baf471056d37cedf0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.115811 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4047b5c941489baf471056d37cedf0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.197279 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4047b5c941489baf471056d37cedf0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.205005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4047b5c941489baf471056d37cedf0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.205663 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-5dde9a22-5617-4c9a-aa86-42bb65978288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4047b5c941489baf471056d37cedf0'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.211981 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1367/2766] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:19 2022] DELETE /identity/v3/users/1f4047b5c941489baf471056d37cedf0 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:20.662803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:20.664380 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:20.677684 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeeaaa-f93a-4f72-898a-eac4045ed211 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:20.738859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:20.739732 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:20.740013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:20.740296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] PATH_INFO: `/v3/projects/cea13e96e46d4f34a31ca995c50106f4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:20.741502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea13e96e46d4f34a31ca995c50106f4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:20.743511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:20.867700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea13e96e46d4f34a31ca995c50106f4', 'request_id': 'req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.875676 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea13e96e46d4f34a31ca995c50106f4', 'request_id': 'req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.881848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea13e96e46d4f34a31ca995c50106f4', 'request_id': 'req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.951633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] The token cache is being invalidate because project cea13e96e46d4f34a31ca995c50106f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:20.951835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.952470 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-f5ebf818-ddf3-4dfa-94b3-ca33e738aed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:20.954055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1400/2767] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:20 2022] DELETE /identity/v3/projects/cea13e96e46d4f34a31ca995c50106f4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:20.959024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:20.959490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:20.961895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:20.965975 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:20.979147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:20.980363 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:21.038277 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1368/2768] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:21.045637 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.045948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.046224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.059141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:21.065746 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:21.066940 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:21.075896 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1401/2769] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:21.080286 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.090126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcacd39d-be02-4a06-bf69-614b9d69d240 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.095201 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.095849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.096126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.096397 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.097110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:29:21.097429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.099125 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.111317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1369/2770] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 24 15:29:21.125593 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.134907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab31da-7091-4198-b0cf-05df9ae56a11 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.140147 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.140800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.141083 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.141361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.142080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.144014 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.227808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1402/2771] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:21.232245 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.242608 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23440389-3769-41ec-8be5-4da5adca6b82 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.299175 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.299846 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.300130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.300406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.301100 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.303041 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.426386 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1370/2772] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/users => generated 278 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:29:21.430553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.441426 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de554d10-dfb1-41b6-b3a5-36f2edb9bd01 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.446253 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.446934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.447202 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.447467 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.448178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.449859 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.460154 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1403/2773] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:21.464181 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.474210 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cbcdf-dbe9-48ea-8e91-a32399a68439 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.478966 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.479565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.479852 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.480130 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.480883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.483014 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c843818-7e84-47cb-9e1f-d79235cc918b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.493185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1371/2774] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:21.497996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.507959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78c12d-2d4b-4719-9902-8afbbb37048d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.512500 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.513361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.513634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.513928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] PATH_INFO: `/v3/projects/bf6b3a763eb84c9c8189f4b6d419045f/users/afcebe07c6874129b227a762f6224dcc/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.530258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6b3a763eb84c9c8189f4b6d419045f, user_id=afcebe07c6874129b227a762f6224dcc, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.532989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.602519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1404/2775] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:21 2022] PUT /identity/v3/projects/bf6b3a763eb84c9c8189f4b6d419045f/users/afcebe07c6874129b227a762f6224dcc/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:21.614414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.614729 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.615011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.641293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] MFA Rules not processed for user `afcebe07c6874129b227a762f6224dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:21.642554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:21.701113 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:21.706071 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1372/2776] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:21.710527 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.772005 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeed4dd1-8889-49e2-ba1d-0db443a81cc4 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.776564 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.777223 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.777505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.777811 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.779027 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.780916 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:21.866408 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1405/2777] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/projects => generated 355 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:21.870618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:21.881191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48735a4f-adb8-42e2-b50c-e6e86add8608 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:21.935977 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:21.936633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:21.936916 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:21.937185 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:21.937897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:21.943491 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.019238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1373/2778] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:21 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:22.023318 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.034299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66974896-0939-42fb-9f96-517e3b93d3d3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.038856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.039522 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.039803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.040067 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.040776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.042443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.052885 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1406/2779] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:22.057082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.067469 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c211c4-562b-458e-8156-d2bcbb4321ef admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.072645 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.073517 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.073835 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.074121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] PATH_INFO: `/v3/projects/14e3678597524a21a4e18b6dc6b02d71/users/4f2cc5a037424ae88b8130fb481202b5/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.089282 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3678597524a21a4e18b6dc6b02d71, user_id=4f2cc5a037424ae88b8130fb481202b5, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.092673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.219624 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1374/2780] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:22 2022] PUT /identity/v3/projects/14e3678597524a21a4e18b6dc6b02d71/users/4f2cc5a037424ae88b8130fb481202b5/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:22.223693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.234386 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25655b-7148-498d-8395-f7d4932eebdc admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.292953 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.293555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.294406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.294680 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.295550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.297130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cdf99a-334d-43f1-ab2f-ba9cc090f516 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.306988 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1407/2781] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:22.311280 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.322039 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45537deb-982c-42ad-988b-e1d8e66e26f9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.327561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.328443 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.328727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.329004 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] PATH_INFO: `/v3/projects/14e3678597524a21a4e18b6dc6b02d71/users/4f2cc5a037424ae88b8130fb481202b5/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.331007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e3678597524a21a4e18b6dc6b02d71, user_id=4f2cc5a037424ae88b8130fb481202b5, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.333636 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.344931 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1375/2782] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:22 2022] PUT /identity/v3/projects/14e3678597524a21a4e18b6dc6b02d71/users/4f2cc5a037424ae88b8130fb481202b5/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:22.355471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.355765 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.356047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.381080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:22.384039 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] MFA Rules not processed for user `4f2cc5a037424ae88b8130fb481202b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:22.385271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:22.454994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1408/2783] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:22 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:22.466928 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.468620 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:22.526625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40917cad-1050-4c5d-8f9c-b1506b7f950f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.530833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.531479 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.531761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.532033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.540935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.542387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.552592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1376/2784] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:22.776502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:22.786950 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b68316-ab0b-44e6-b829-533b020a82d0 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:22.790529 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:22.791170 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:22.791446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:22.791719 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:22.852715 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:22.854195 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff55c4-ac77-416a-a59e-ed50177aec03 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:22.863822 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1409/2785] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:22 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:32.548148 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=71,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:32.860137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=56 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:40.226333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:40.289297 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8b64a-2cad-4365-bb1a-5fadb5c15b81 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:40.294730 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:40.294914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:40.295073 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:40.295352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] PATH_INFO: `/v3/users/afcebe07c6874129b227a762f6224dcc` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:40.296548 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcebe07c6874129b227a762f6224dcc)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:40.298554 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:40.515196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcebe07c6874129b227a762f6224dcc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:40.528072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcebe07c6874129b227a762f6224dcc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:40.601522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcebe07c6874129b227a762f6224dcc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:40.608864 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcebe07c6874129b227a762f6224dcc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:40.609909 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcebe07c6874129b227a762f6224dcc'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:40.615545 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1377/2786] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:40 2022] DELETE /identity/v3/users/afcebe07c6874129b227a762f6224dcc => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:40.620094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:40.620582 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:40.620689 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:40.638174 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:40.639377 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:40.698986 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1410/2787] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:40.708895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:40.710955 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:40.775709 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fef27a-b7cc-48aa-a498-cc24f579f563 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:40.779409 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:40.780057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:40.780343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:40.780617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:40.790706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:40.792254 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:40.802603 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1378/2788] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:41.227020 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:41.228459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:41.242872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29677a-690c-4a89-aed2-a281d63ee3d3 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:41.247788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:41.251113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:41.251113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:41.251113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] PATH_INFO: `/v3/projects/bf6b3a763eb84c9c8189f4b6d419045f` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:41.251113 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6b3a763eb84c9c8189f4b6d419045f)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:41.252538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:41.397215 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6b3a763eb84c9c8189f4b6d419045f', 'request_id': 'req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.403478 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6b3a763eb84c9c8189f4b6d419045f', 'request_id': 'req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.409227 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6b3a763eb84c9c8189f4b6d419045f', 'request_id': 'req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.498490 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] The token cache is being invalidate because project bf6b3a763eb84c9c8189f4b6d419045f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:41.498779 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.499393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.500982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1411/2789] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:41 2022] DELETE /identity/v3/projects/bf6b3a763eb84c9c8189f4b6d419045f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:41.505152 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:41.514851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948b5ce-116f-4098-b2bb-0d20fb6ed8df service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:41.533840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:41.572769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:41.573633 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:41.573954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:41.574226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] PATH_INFO: `/v3/users/4f2cc5a037424ae88b8130fb481202b5` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:41.575406 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2cc5a037424ae88b8130fb481202b5)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:41.577356 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:41.804626 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2cc5a037424ae88b8130fb481202b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.816352 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2cc5a037424ae88b8130fb481202b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.887081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2cc5a037424ae88b8130fb481202b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.894508 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2cc5a037424ae88b8130fb481202b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.897711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c2806166-4b86-4ea2-a3df-d59b7a04c691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2cc5a037424ae88b8130fb481202b5'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:41.901679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1379/2790] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:41 2022] DELETE /identity/v3/users/4f2cc5a037424ae88b8130fb481202b5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:42.356718 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:42.358350 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:42.372400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea908273-96e1-4d63-9ac0-e9bb9d6f4ab9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:42.438462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:42.439327 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:42.439605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:42.439905 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] PATH_INFO: `/v3/projects/14e3678597524a21a4e18b6dc6b02d71` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:42.441247 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e3678597524a21a4e18b6dc6b02d71)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:42.443263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:42.580610 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:42.597220 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e3678597524a21a4e18b6dc6b02d71', 'request_id': 'req-9416c653-221c-4e29-a274-71ecf8c7fbd3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:42.603750 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e3678597524a21a4e18b6dc6b02d71', 'request_id': 'req-9416c653-221c-4e29-a274-71ecf8c7fbd3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:42.609263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e3678597524a21a4e18b6dc6b02d71', 'request_id': 'req-9416c653-221c-4e29-a274-71ecf8c7fbd3'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:42.721620 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] The token cache is being invalidate because project 14e3678597524a21a4e18b6dc6b02d71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:42.721948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:42.722561 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-9416c653-221c-4e29-a274-71ecf8c7fbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:42.724098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1412/2791] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:42 2022] DELETE /identity/v3/projects/14e3678597524a21a4e18b6dc6b02d71 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:42.730617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:42.731395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:42.731741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:42.749783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:42.750997 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:42.817710 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1380/2792] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:42.826866 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:42.827152 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:42.827432 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:42.846590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:42.847800 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:42.856584 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1413/2793] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 24 15:29:42.860968 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:42.871682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4d2d-2fd1-4cec-99a2-82043eb04b21 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:42.876541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:42.877193 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:42.877476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:42.877785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:42.878514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:29:42.878833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:42.880486 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:42.892656 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1381/2794] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:29:42.897015 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:42.906369 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7169cad9-c5e5-4394-bccb-09ae41eb9453 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:42.911248 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:42.911978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:42.912263 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:42.912536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:42.913224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:42.915729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:42.981381 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1414/2795] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:42 2022] POST /identity/v3/projects => generated 399 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:42.985418 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:42.996213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef021f9-6b87-4962-ada3-9687bdeab0e6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.021842 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:43.054644 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.055343 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.055632 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.055908 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.056600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.058617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.191383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1382/2796] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:42 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:43.195808 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.206286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b0608-8599-45e3-9cf8-3c75e349a37a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.211761 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.212550 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.212831 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.213103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.214013 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.215714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.227659 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1415/2797] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:43.231526 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.241670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566c669-4bde-4595-9f4b-fb56e1cbd592 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.246388 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.251139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.251139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.251139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.251139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.251139 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7adfb-05b0-415b-b533-9e4829e1b0d9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.259883 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1383/2798] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:43.263907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.275450 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37432af3-9788-4778-a7f1-a6d81f4ad2b3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.280110 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.280991 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.281274 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.281552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] PATH_INFO: `/v3/projects/d9eabef6edab4543a6c8df43dc6ae3ad/users/b282d2bc8fde4077a7caff0f000f50d2/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.296884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9eabef6edab4543a6c8df43dc6ae3ad, user_id=b282d2bc8fde4077a7caff0f000f50d2, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.299580 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.385557 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1416/2799] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:43 2022] PUT /identity/v3/projects/d9eabef6edab4543a6c8df43dc6ae3ad/users/b282d2bc8fde4077a7caff0f000f50d2/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:43.395900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.396191 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.396474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.423699 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] MFA Rules not processed for user `b282d2bc8fde4077a7caff0f000f50d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:43.424930 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:43.488763 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1384/2800] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:43.493277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.554743 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666185d5-892d-4eed-8262-eaa4bdca2156 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.559538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.560186 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.560472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.560754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.561449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.563411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.689178 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1417/2801] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:43 2022] POST /identity/v3/projects => generated 399 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:43.693205 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.704553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813582eb-54a5-4766-b6e3-f00eff0386e6 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.759498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.760183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.760427 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.760703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.761396 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.763334 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.875783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1385/2802] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:43 2022] POST /identity/v3/users => generated 306 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:29:43.879794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.890661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc941ca-0546-4aba-8862-8a75ba8f97a9 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.895201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc369-191b-497f-bd28-836446596edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.895830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc369-191b-497f-bd28-836446596edd admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.896151 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc369-191b-497f-bd28-836446596edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.896428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56adc369-191b-497f-bd28-836446596edd admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.897142 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adc369-191b-497f-bd28-836446596edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.898774 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56adc369-191b-497f-bd28-836446596edd admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:43.909803 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1418/2803] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:29:43.913941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:43.923920 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a7e39-f41c-4257-aa1a-b1f40c95dcdf admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:43.928579 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:43.929447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:43.930290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:43.930568 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] PATH_INFO: `/v3/projects/9163c57bd9444354ad4728af1f9faf87/users/6a4d3f9cf1aa41c39329e8b9f0c557ca/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:43.946318 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9163c57bd9444354ad4728af1f9faf87, user_id=6a4d3f9cf1aa41c39329e8b9f0c557ca, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:43.948987 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:44.030473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1386/2804] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:43 2022] PUT /identity/v3/projects/9163c57bd9444354ad4728af1f9faf87/users/6a4d3f9cf1aa41c39329e8b9f0c557ca/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:44.034628 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc369-191b-497f-bd28-836446596edd admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:44.044690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56adc369-191b-497f-bd28-836446596edd admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:44.064754 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:44.100998 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:44.101664 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:44.101996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:44.102302 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:44.103034 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:44.105109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71379c-f38e-4578-90b9-1c019d4edb11 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:44.115230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1419/2805] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:44.119943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:44.125522 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:44.130911 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaac93a-b28e-40e6-aa94-a31d02eaa802 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:44.136189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:44.137080 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:44.137340 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:44.137618 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] PATH_INFO: `/v3/projects/9163c57bd9444354ad4728af1f9faf87/users/6a4d3f9cf1aa41c39329e8b9f0c557ca/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:44.139611 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9163c57bd9444354ad4728af1f9faf87, user_id=6a4d3f9cf1aa41c39329e8b9f0c557ca, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:44.142431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:44.152759 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1387/2806] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:44 2022] PUT /identity/v3/projects/9163c57bd9444354ad4728af1f9faf87/users/6a4d3f9cf1aa41c39329e8b9f0c557ca/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:44.162889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:44.163201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:44.163476 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:44.190686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] MFA Rules not processed for user `6a4d3f9cf1aa41c39329e8b9f0c557ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:44.191889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:44.263275 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1420/2807] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:44 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:44.273894 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:44.276227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:44.332912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e320e-3d0c-4700-8e46-7b3d961d83c9 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:44.336557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:44.337189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:44.337472 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:44.337771 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:44.346921 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:44.348395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:44.358658 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1388/2808] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:44.541471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:44.552251 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b224c04e-4425-46fb-be57-b95fe7a075be None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:44.555870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:44.556479 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:44.556787 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:44.557059 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:44.613805 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:44.615240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813acc36-cc2a-40b7-a991-7b76ce8bf62f service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:44.624289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1421/2809] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:49.703296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:49.766786 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05f339-477a-4253-8bb7-1ebabe916196 service cinder] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:49.771411 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:49.772273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:49.772557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:49.772833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] PATH_INFO: `/v3/users/b282d2bc8fde4077a7caff0f000f50d2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:49.774054 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b282d2bc8fde4077a7caff0f000f50d2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:49.776013 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:49.970982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b282d2bc8fde4077a7caff0f000f50d2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:49.984268 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b282d2bc8fde4077a7caff0f000f50d2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.070426 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b282d2bc8fde4077a7caff0f000f50d2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.077895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b282d2bc8fde4077a7caff0f000f50d2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.078558 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b282d2bc8fde4077a7caff0f000f50d2'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.084691 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1389/2810] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:49 2022] DELETE /identity/v3/users/b282d2bc8fde4077a7caff0f000f50d2 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:50.090127 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:50.090646 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:50.090748 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:50.109284 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:50.110543 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:50.151286 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=100 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:50.169776 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1422/2811] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:50.179368 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:50.180795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:50.194097 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:50.240831 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd7496-f88e-47a7-81c4-d51fbecd501a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:50.244539 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:50.245173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:50.245452 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:50.245741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:50.254923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:50.256333 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:50.267061 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1390/2812] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:50.694433 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:50.696155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:50.709636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dd7f7-50d0-43a8-bb6b-a1aeea16a75b None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:50.716194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee366234-e886-4227-bf77-be312019590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:50.716634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee366234-e886-4227-bf77-be312019590f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:50.716918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee366234-e886-4227-bf77-be312019590f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:50.717199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee366234-e886-4227-bf77-be312019590f admin admin] PATH_INFO: `/v3/projects/d9eabef6edab4543a6c8df43dc6ae3ad` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:50.718428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee366234-e886-4227-bf77-be312019590f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9eabef6edab4543a6c8df43dc6ae3ad)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:50.720409 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee366234-e886-4227-bf77-be312019590f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:50.813609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9eabef6edab4543a6c8df43dc6ae3ad', 'request_id': 'req-ee366234-e886-4227-bf77-be312019590f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.819788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9eabef6edab4543a6c8df43dc6ae3ad', 'request_id': 'req-ee366234-e886-4227-bf77-be312019590f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.826337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9eabef6edab4543a6c8df43dc6ae3ad', 'request_id': 'req-ee366234-e886-4227-bf77-be312019590f'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.897046 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] The token cache is being invalidate because project d9eabef6edab4543a6c8df43dc6ae3ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:50.900514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.900514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:50.900514 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1423/2813] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:50 2022] DELETE /identity/v3/projects/d9eabef6edab4543a6c8df43dc6ae3ad => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:50.903419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:50.913059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e623e-ba6d-4963-afc9-5ae8f06d64ce service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:50.969605 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:50.970504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:50.970764 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:50.971031 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] PATH_INFO: `/v3/users/6a4d3f9cf1aa41c39329e8b9f0c557ca` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:50.972207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a4d3f9cf1aa41c39329e8b9f0c557ca)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:50.974147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:51.192316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a4d3f9cf1aa41c39329e8b9f0c557ca'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.205063 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a4d3f9cf1aa41c39329e8b9f0c557ca'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.276463 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a4d3f9cf1aa41c39329e8b9f0c557ca'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.284011 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a4d3f9cf1aa41c39329e8b9f0c557ca'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.284727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c606f811-47de-4856-892c-2f2ee88e7c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a4d3f9cf1aa41c39329e8b9f0c557ca'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.291476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1391/2814] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:50 2022] DELETE /identity/v3/users/6a4d3f9cf1aa41c39329e8b9f0c557ca => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:51.739960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:51.741568 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:51.757130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee366234-e886-4227-bf77-be312019590f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:51.813658 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:51.814542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:51.814819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:51.815092 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] PATH_INFO: `/v3/projects/9163c57bd9444354ad4728af1f9faf87` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:51.816250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9163c57bd9444354ad4728af1f9faf87)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:51.818189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:51.904319 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9163c57bd9444354ad4728af1f9faf87', 'request_id': 'req-685134c7-a1c9-4cb4-a5ac-c324e230958b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.910540 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9163c57bd9444354ad4728af1f9faf87', 'request_id': 'req-685134c7-a1c9-4cb4-a5ac-c324e230958b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.915904 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9163c57bd9444354ad4728af1f9faf87', 'request_id': 'req-685134c7-a1c9-4cb4-a5ac-c324e230958b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.967496 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:51.971842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] The token cache is being invalidate because project 9163c57bd9444354ad4728af1f9faf87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:51.972130 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.972771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-685134c7-a1c9-4cb4-a5ac-c324e230958b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:51.974362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1424/2815] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:51 2022] DELETE /identity/v3/projects/9163c57bd9444354ad4728af1f9faf87 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:51.979246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:51.980017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:51.980017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:51.998033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:51.999198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:52.029251 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:52.059074 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1392/2816] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:52.067944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.068256 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.068574 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.087583 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:52.088764 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:52.096636 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1425/2817] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:52.100939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.110717 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b0879-6404-4866-bfb4-47dfe0bd2eb3 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.115344 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.115990 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.116274 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.116553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.117300 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:29:52.117874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.119823 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.131937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1393/2818] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:29:52.136783 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.146203 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a50908-004b-4b06-aa26-104f36f2a6f7 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.150842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.151489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.151771 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.152047 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.152726 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.154693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.266518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1426/2819] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:52.270857 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.281005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d630b-0bbc-4980-9f1f-e95e490650ad admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.338688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.339351 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.339630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.339904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.340578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.342514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.442681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1394/2820] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:29:52.446836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.457311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c0803-557e-4ec7-8d44-24b83fd29137 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.461995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.462648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.462931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.463208 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.463933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.465519 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.476612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1427/2821] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:52.481091 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.491468 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3055a-84b5-4451-b764-c6d9d92a8ad6 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.496805 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.497529 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.497861 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.498142 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.498960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.500544 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b999d6-d610-400c-8af5-b2748795553b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.510775 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1395/2822] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:52.515505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.525588 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae460efd-96a0-4819-92d2-50a990e93af1 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.530185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.531082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.531378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.531655 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] PATH_INFO: `/v3/projects/2f8e3c93f18e4f8b906dd200d62473b2/users/62d39fda2cdf4edabcf74ac35fae9bc1/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.547086 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f8e3c93f18e4f8b906dd200d62473b2, user_id=62d39fda2cdf4edabcf74ac35fae9bc1, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.549857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.670320 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1428/2823] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:52 2022] PUT /identity/v3/projects/2f8e3c93f18e4f8b906dd200d62473b2/users/62d39fda2cdf4edabcf74ac35fae9bc1/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:52.680679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.680972 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.681447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.708474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] MFA Rules not processed for user `62d39fda2cdf4edabcf74ac35fae9bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:52.709690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:52.774736 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1396/2824] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:52.779462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.842159 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eccf0cc-8593-4d7a-adb0-4d048e1a7605 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.847043 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:52.847702 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:52.847987 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:52.848264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:52.848961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:52.850893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:52.928874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1429/2825] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 24 15:29:52.933290 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:52.943941 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f571964-db47-4695-8b3c-79bc4105160e None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:52.970109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:52.999853 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.000896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.001029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.001339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.002048 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.004400 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.078235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1397/2826] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:52 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:53.082210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:53.092713 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d4770-7e13-4d3f-9f8e-3d58c447077f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:53.097405 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.098094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.098371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.098641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.099362 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.101003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.112364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1430/2827] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:53.116767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:53.127802 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ed798-b6f2-4c60-865c-d44f3c7d6f4b admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:53.132504 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.133498 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.133812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.134115 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] PATH_INFO: `/v3/projects/6188cd2a542d46a085d4ff50973b6904/users/d95285e44e2f4b0abdabc893178b9681/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.149227 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6188cd2a542d46a085d4ff50973b6904, user_id=d95285e44e2f4b0abdabc893178b9681, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.151901 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.225380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1398/2828] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:53 2022] PUT /identity/v3/projects/6188cd2a542d46a085d4ff50973b6904/users/d95285e44e2f4b0abdabc893178b9681/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:53.229906 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:53.240155 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437f648-b5ab-42d6-9574-4b6c4bb41e5d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:53.296153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.296796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.297077 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.297352 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.298104 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.299696 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d4ce4-3486-4eda-a80a-ba278ece3a00 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.310049 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1431/2829] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:53.314600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:53.325171 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25dbad-13ed-4555-9058-3292359f76f3 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:53.329867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.331437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.331437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.331437 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] PATH_INFO: `/v3/projects/6188cd2a542d46a085d4ff50973b6904/users/d95285e44e2f4b0abdabc893178b9681/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.333170 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6188cd2a542d46a085d4ff50973b6904, user_id=d95285e44e2f4b0abdabc893178b9681, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.335836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.346173 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1399/2830] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:53 2022] PUT /identity/v3/projects/6188cd2a542d46a085d4ff50973b6904/users/d95285e44e2f4b0abdabc893178b9681/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:53.357538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.357863 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.358173 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.364891 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:53.384856 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] MFA Rules not processed for user `d95285e44e2f4b0abdabc893178b9681`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:53.386131 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:53.454236 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1432/2831] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:53.465348 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:53.467029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:53.522640 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74397b-50af-4940-af9f-3fa83edb4961 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:53.526704 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:53.527339 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:53.527617 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:53.527890 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:53.536850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:53.538316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3de44c-b3d5-4067-bca0-be63cd775c19 service cinder] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:53.548172 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1400/2832] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:53 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:54.706934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:54.769925 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b9e42-38f1-4f42-908a-d55abaed4647 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:54.774548 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:54.775410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:54.775693 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:54.775972 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] PATH_INFO: `/v3/users/62d39fda2cdf4edabcf74ac35fae9bc1` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:54.778124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d39fda2cdf4edabcf74ac35fae9bc1)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:54.779098 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:54.997797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d39fda2cdf4edabcf74ac35fae9bc1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.009423 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d39fda2cdf4edabcf74ac35fae9bc1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.081445 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d39fda2cdf4edabcf74ac35fae9bc1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.082614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d39fda2cdf4edabcf74ac35fae9bc1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.095819 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d39fda2cdf4edabcf74ac35fae9bc1'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.102264 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1433/2833] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:54 2022] DELETE /identity/v3/users/62d39fda2cdf4edabcf74ac35fae9bc1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:55.107741 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:55.108206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:55.108353 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:55.125769 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:55.126903 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:55.184137 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1401/2834] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:55.193807 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:55.195477 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:55.206565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:55.258008 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e8230-762b-4463-8473-5941142d323c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:55.263055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:55.264042 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:55.264590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:55.265563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:55.274823 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:55.276879 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:55.286930 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1434/2835] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:29:55.700502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:55.702126 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:55.720925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3faaf1-1e82-4438-9527-5a4195a08381 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:55.720925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:55.720925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:55.721335 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:55.721616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] PATH_INFO: `/v3/projects/2f8e3c93f18e4f8b906dd200d62473b2` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:55.722863 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f8e3c93f18e4f8b906dd200d62473b2)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:55.724795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:55.747313 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:55.842087 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f8e3c93f18e4f8b906dd200d62473b2', 'request_id': 'req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.848557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f8e3c93f18e4f8b906dd200d62473b2', 'request_id': 'req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.915625 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f8e3c93f18e4f8b906dd200d62473b2', 'request_id': 'req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.927536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] The token cache is being invalidate because project 2f8e3c93f18e4f8b906dd200d62473b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:55.927825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.928473 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:55.930129 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1402/2836] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:55 2022] DELETE /identity/v3/projects/2f8e3c93f18e4f8b906dd200d62473b2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:55.934682 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:55.944872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c654d4af-f367-4226-be73-9751b10c52c9 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:56.003314 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:56.004189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:56.004471 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:56.004747 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] PATH_INFO: `/v3/users/d95285e44e2f4b0abdabc893178b9681` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:56.005965 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95285e44e2f4b0abdabc893178b9681)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:56.007878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:56.175463 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95285e44e2f4b0abdabc893178b9681'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.188117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95285e44e2f4b0abdabc893178b9681'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.241756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95285e44e2f4b0abdabc893178b9681'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.242442 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95285e44e2f4b0abdabc893178b9681'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.251928 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-056c9fb8-17b9-4b77-aa4e-1fc3ee928aef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95285e44e2f4b0abdabc893178b9681'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.259040 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1435/2837] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:29:55 2022] DELETE /identity/v3/users/d95285e44e2f4b0abdabc893178b9681 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:56.665565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:56.667675 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:56.686422 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf925f-c2fc-4442-8cbe-3021df6c3c0c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:56.751915 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:56.752706 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:56.752956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:56.753213 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] PATH_INFO: `/v3/projects/6188cd2a542d46a085d4ff50973b6904` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:56.754410 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6188cd2a542d46a085d4ff50973b6904)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:56.756309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:56.876066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6188cd2a542d46a085d4ff50973b6904', 'request_id': 'req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:56.882271 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6188cd2a542d46a085d4ff50973b6904', 'request_id': 'req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:57.001197 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6188cd2a542d46a085d4ff50973b6904', 'request_id': 'req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:57.012892 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] The token cache is being invalidate because project 6188cd2a542d46a085d4ff50973b6904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80512) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:29:57.013121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:57.013778 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-6b7e4fab-e6b6-4dc8-97e6-25861c3db9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:29:57.015336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1403/2838] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:29:56 2022] DELETE /identity/v3/projects/6188cd2a542d46a085d4ff50973b6904 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:57.020313 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.020801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.020900 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.039033 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:57.040311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:57.066403 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:57.104820 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1436/2839] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:57.112969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.113258 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.113535 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.131935 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:57.133155 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:57.141587 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1404/2840] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:57.145769 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.156108 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a2804-9b3a-401d-b1f7-1b3032b5804a None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.160709 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.161357 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.161641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.161948 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.162671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80513) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:29:57.162978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.164565 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.176235 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1437/2841] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:29:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:29:57.180642 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.190380 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00992104-7f06-4d39-a429-e9c0dd9e7dcc None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.195317 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.195951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.196230 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.196500 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.197228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.199687 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.329431 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1405/2842] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:57.333749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.343888 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d12281-c0b0-48c0-ab5d-9a4086a72d6c admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.400942 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.401613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.401921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.402198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.402878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.404785 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.521762 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1438/2843] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:57.526149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.536855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c795224-6d19-4afe-8b16-b4650ee966ac admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.541408 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.542107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.542389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.542760 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.543482 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.545062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.547199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:57.556056 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1406/2844] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:57.560595 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.570989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2659bd-d436-4996-8bed-9e40abb71cca admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.576201 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.576854 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.577137 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.577416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.578182 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.579828 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39806ef9-b45d-428a-88df-f673518819b2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.589967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1439/2845] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:57.594255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.603938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a285-eeec-4f86-86f4-41356e82b77c admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.609036 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.610238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.610521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.610937 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] PATH_INFO: `/v3/projects/a62c24cf8683446fb557c1f4eab73095/users/f4cee8eb33034f05a34acb717fa36fbd/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.627079 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62c24cf8683446fb557c1f4eab73095, user_id=f4cee8eb33034f05a34acb717fa36fbd, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.629855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:57.704077 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1407/2846] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:57 2022] PUT /identity/v3/projects/a62c24cf8683446fb557c1f4eab73095/users/f4cee8eb33034f05a34acb717fa36fbd/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:57.714425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.714723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.715022 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.742074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] MFA Rules not processed for user `f4cee8eb33034f05a34acb717fa36fbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:57.743407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:57.805459 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1440/2847] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:57.810638 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:57.871727 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3629f1-5aff-4371-ad93-ce746b43917f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:57.876619 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:57.877950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:57.878238 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:57.878553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:57.879248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:57.881149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.019610 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1408/2848] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:29:57 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:58.023643 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.034839 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3cfab-1af2-48eb-8798-07e2bb1e7c80 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.059177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:58.091245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.091913 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.092190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.092466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] PATH_INFO: `/v3/users` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.093163 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.095099 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.178729 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1441/2849] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:29:58 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:29:58.183231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.193665 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1581c54d-ac91-465e-97a3-c01ddf46fe21 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.198678 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.199314 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.199596 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.199876 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.200601 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.202226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.215294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1409/2850] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:58.219416 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.230443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa352749-d1c9-4da4-806d-fc8b31fc569f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.235245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.236149 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.236428 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.236698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] PATH_INFO: `/v3/projects/58103b4b52164797a1b6db3f1dea79bd/users/063f411eddfd4982b326afadcc62a684/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.251501 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] RBAC: Authorizing `identity:create_grant(project_id=58103b4b52164797a1b6db3f1dea79bd, user_id=063f411eddfd4982b326afadcc62a684, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.254184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.310773 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1442/2851] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:58 2022] PUT /identity/v3/projects/58103b4b52164797a1b6db3f1dea79bd/users/063f411eddfd4982b326afadcc62a684/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:58.314856 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.325830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fc0a45-04bc-4e6b-99f3-870701b0a19a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.382082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.382762 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.383021 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.383293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.384002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.386218 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120cdff-cb6b-4591-bdb2-0c6aa56d2729 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.396398 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1410/2852] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:29:58.400605 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.411725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a13a5-fc2b-496c-a822-fe1b19a4607f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.416427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.417334 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.417612 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.417915 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] PATH_INFO: `/v3/projects/58103b4b52164797a1b6db3f1dea79bd/users/063f411eddfd4982b326afadcc62a684/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.419884 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=58103b4b52164797a1b6db3f1dea79bd, user_id=063f411eddfd4982b326afadcc62a684, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.422563 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.432796 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1443/2853] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:29:58 2022] PUT /identity/v3/projects/58103b4b52164797a1b6db3f1dea79bd/users/063f411eddfd4982b326afadcc62a684/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:29:58.501711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.502029 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.502355 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.529518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] MFA Rules not processed for user `063f411eddfd4982b326afadcc62a684`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:29:58.530770 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:58.562939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:29:58.599058 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1411/2854] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:29:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:29:58.609974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:29:58.611679 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:29:58.669541 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2fc4a-4567-4c9d-9a8d-3d8035c90abb admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:29:58.673124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:29:58.673817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:29:58.674094 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:29:58.674364 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:29:58.729604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:29:58.730989 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c4885-7b8c-4bc2-8a9a-9be3cc7262c1 service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:29:58.739949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1444/2855] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:29:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:01.697774 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:01.760266 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094c3a-4a9b-47ab-bd10-cfb4b2abc2b8 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:01.765392 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:01.766283 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:01.766565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:01.766841 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] PATH_INFO: `/v3/users/f4cee8eb33034f05a34acb717fa36fbd` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:01.768024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4cee8eb33034f05a34acb717fa36fbd)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:01.769960 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:01.958336 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4cee8eb33034f05a34acb717fa36fbd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:01.970017 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4cee8eb33034f05a34acb717fa36fbd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.017946 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4cee8eb33034f05a34acb717fa36fbd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.025776 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4cee8eb33034f05a34acb717fa36fbd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.026570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4cee8eb33034f05a34acb717fa36fbd'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.032843 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1412/2856] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:30:01 2022] DELETE /identity/v3/users/f4cee8eb33034f05a34acb717fa36fbd => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:02.037449 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:02.037981 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:02.038107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:02.055392 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:02.056578 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:02.085661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:02.114827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1445/2857] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:02.125207 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:02.126669 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:02.180592 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:02.185000 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb7f83-d1b1-43aa-9bbf-56e00ee67444 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:02.188780 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:02.189416 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:02.189745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:02.190023 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:02.199275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:02.200690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:02.211033 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1413/2858] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:02.619559 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:02.621472 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:02.634044 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca61ff-c8b1-42e8-bebd-c19f9fc5a8ee None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:02.638857 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:02.639801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:02.640082 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:02.640355 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] PATH_INFO: `/v3/projects/a62c24cf8683446fb557c1f4eab73095` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:02.641523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62c24cf8683446fb557c1f4eab73095)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:02.643721 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:02.755685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62c24cf8683446fb557c1f4eab73095', 'request_id': 'req-6ec8d29a-e26b-42cd-8657-5f54c81298d5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.761961 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62c24cf8683446fb557c1f4eab73095', 'request_id': 'req-6ec8d29a-e26b-42cd-8657-5f54c81298d5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.767608 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62c24cf8683446fb557c1f4eab73095', 'request_id': 'req-6ec8d29a-e26b-42cd-8657-5f54c81298d5'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.857597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] The token cache is being invalidate because project a62c24cf8683446fb557c1f4eab73095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:30:02.857921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.858552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:02.860109 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1446/2859] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:30:02 2022] DELETE /identity/v3/projects/a62c24cf8683446fb557c1f4eab73095 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:02.864161 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:02.875160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f926b00-dd92-4c93-a308-a28322b5ef00 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:02.933518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:02.934938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:02.935272 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:02.935553 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] PATH_INFO: `/v3/users/063f411eddfd4982b326afadcc62a684` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:02.936814 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063f411eddfd4982b326afadcc62a684)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:02.938777 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:03.170810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063f411eddfd4982b326afadcc62a684'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.182963 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063f411eddfd4982b326afadcc62a684'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.246670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063f411eddfd4982b326afadcc62a684'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.254249 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063f411eddfd4982b326afadcc62a684'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.255020 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-3060d63c-aa95-4766-a5db-ea4f817345f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063f411eddfd4982b326afadcc62a684'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.260878 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1414/2860] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:30:02 2022] DELETE /identity/v3/users/063f411eddfd4982b326afadcc62a684 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:03.700028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:03.701513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:03.716070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8d29a-e26b-42cd-8657-5f54c81298d5 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:03.776650 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:03.778118 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:03.778393 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:03.778661 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] PATH_INFO: `/v3/projects/58103b4b52164797a1b6db3f1dea79bd` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:03.779880 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58103b4b52164797a1b6db3f1dea79bd)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:03.781827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:03.893189 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58103b4b52164797a1b6db3f1dea79bd', 'request_id': 'req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.899375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58103b4b52164797a1b6db3f1dea79bd', 'request_id': 'req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.903887 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:03.906074 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58103b4b52164797a1b6db3f1dea79bd', 'request_id': 'req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.978079 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] The token cache is being invalidate because project 58103b4b52164797a1b6db3f1dea79bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:30:03.978361 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.978979 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-8a4073a8-3a7b-4c3e-ba8d-5d99cd06a4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:03.980518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1447/2861] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:30:03 2022] DELETE /identity/v3/projects/58103b4b52164797a1b6db3f1dea79bd => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:03.985567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:03.986066 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:03.986187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.004533 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:04.005755 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:04.064112 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1415/2862] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:04.071858 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.072136 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.072411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.091271 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:04.092469 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:04.100289 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1448/2863] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:04.104502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.114267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef5cda6-53f5-45a1-bfa8-5a0ca2abfdc9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.118913 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.119565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.119849 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.120133 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.121358 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:30:04.121668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.123287 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.130030 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:04.135083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1416/2864] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:30:04.140026 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.149427 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083652a-9c53-4f2d-9302-9a6f3affefe2 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.154060 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.154697 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.154978 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.155246 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.155919 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.157837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.225843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1449/2865] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:30:04 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:30:04.230086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.240395 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba967d4-4862-4135-85a6-03d1e778880f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.296580 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.297233 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.297518 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.297825 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.298509 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.300430 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.356449 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1417/2866] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:30:04 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:30:04.360660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.371757 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da89f7c-ae43-4398-8adf-b51e57de1921 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.377030 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.377685 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.377996 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.378277 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.378999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.380597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.391531 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1450/2867] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:30:04.395664 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.405854 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb49ac-55de-41bb-86d4-bb91b3f501f0 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.410570 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.411235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.411519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.411795 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.412523 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.414153 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102714f-227e-47c2-8286-41e0dfb0694c admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.424885 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1418/2868] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:30:04.429233 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.439958 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1add2aa9-7d50-4fc8-bd3a-411a221a9c8d admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.444585 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.445847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.446128 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.446406 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] PATH_INFO: `/v3/projects/129eaf812c10489491fc43fd864885e3/users/edad6b83d91c4cca9d6c1d758b299776/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.460899 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129eaf812c10489491fc43fd864885e3, user_id=edad6b83d91c4cca9d6c1d758b299776, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.463569 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.526840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1451/2869] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:30:04 2022] PUT /identity/v3/projects/129eaf812c10489491fc43fd864885e3/users/edad6b83d91c4cca9d6c1d758b299776/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:04.531912 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f69c3-9c28-4b63-ae25-2d35c606bad8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.532199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f69c3-9c28-4b63-ae25-2d35c606bad8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.532476 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f69c3-9c28-4b63-ae25-2d35c606bad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.550676 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-af2f69c3-9c28-4b63-ae25-2d35c606bad8 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:04.551948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-af2f69c3-9c28-4b63-ae25-2d35c606bad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:04.610442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1419/2870] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:04.620028 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:04.622410 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:04.681153 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c7b49-53e0-4518-8e46-744952e4b159 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:04.684848 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:04.685510 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:04.685827 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:04.686103 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:04.695745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:04.697213 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:04.706671 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1452/2871] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:05.915383 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294856d-4fe4-4ef4-b83b-f9c6db47f08e None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:05.915914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294856d-4fe4-4ef4-b83b-f9c6db47f08e None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:05.915914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294856d-4fe4-4ef4-b83b-f9c6db47f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:05.946001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-8294856d-4fe4-4ef4-b83b-f9c6db47f08e None None] MFA Rules not processed for user `edad6b83d91c4cca9d6c1d758b299776`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:05.947260 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8294856d-4fe4-4ef4-b83b-f9c6db47f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:06.013059 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1420/2872] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:06.023690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:06.025232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:06.083407 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd1d6f-7278-4d1d-b107-56fb96237a85 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:06.087003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df781318-b23f-483c-8074-638f525886cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd167f6076c5745169fede7f865e056da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:06.087639 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781318-b23f-483c-8074-638f525886cb service cinder] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:06.087920 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781318-b23f-483c-8074-638f525886cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:06.088190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781318-b23f-483c-8074-638f525886cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:06.096497 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781318-b23f-483c-8074-638f525886cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:06.097955 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781318-b23f-483c-8074-638f525886cb service cinder] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:06.107371 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1453/2873] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:07.851582 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:07.852214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:07.852214 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:07.864565 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:07.870248 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] MFA Rules not processed for user `edad6b83d91c4cca9d6c1d758b299776`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:07.871442 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:07.878226 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1421/2874] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:09.618907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df781318-b23f-483c-8074-638f525886cb service cinder] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:09.620346 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-df781318-b23f-483c-8074-638f525886cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:09.652931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:09.696518 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df781318-b23f-483c-8074-638f525886cb service cinder] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:09.702546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:09.703532 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:09.704055 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:09.704745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:09.706886 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:09.719558 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:09.721139 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:09.732003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1454/2875] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:16.397515 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:16.399255 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:16.481812 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0887d8-ec06-4873-8212-a952ec3e20d9 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:16.489303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:16.490578 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:16.490898 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:16.491180 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:16.493002 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:16.506641 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:16.508275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:16.519537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1422/2876] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:19.755111 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=19 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:21.872001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:21.872001 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:21.881157 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015dee8-ba3c-49b8-b6ca-aa63a6b96585 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:21.886901 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:21.887536 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:21.887816 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:21.888091 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:21.890003 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:21.902073 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:21.903630 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c99fcc-2893-448c-b21e-fc93e9a2a45b service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:21.916552 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1455/2877] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:23.023083 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:23.048084 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fef5a69-8998-4f99-8c97-8054f8bb4fd3 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:23.061275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:23.061813 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:23.062057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:23.062342 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:23.064703 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:23.090174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:23.092541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:23.109316 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1423/2878] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:31.904723 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd7a-4d5e-4fa5-b772-c28590eeef2c None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:31.905230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd7a-4d5e-4fa5-b772-c28590eeef2c None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:31.905230 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382fd7a-4d5e-4fa5-b772-c28590eeef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:31.923226 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-7382fd7a-4d5e-4fa5-b772-c28590eeef2c None None] MFA Rules not processed for user `edad6b83d91c4cca9d6c1d758b299776`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:31.924462 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-7382fd7a-4d5e-4fa5-b772-c28590eeef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:31.931837 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1456/2879] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:30:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:32.167910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:32.169381 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:32.181564 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de5e58-2aa3-4185-827c-f045168ffafa service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:32.185575 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:32.186273 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:32.186557 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:32.186833 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:32.188651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:32.199481 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:32.200895 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:32.211043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1424/2880] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:33.587725 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:33.588184 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:33.588278 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:33.607261 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:33.608526 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:33.664917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1457/2881] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:30:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:33.828384 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:33.829905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:33.908401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0f198-f4ee-4432-967c-c80e516bf2a8 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:33.913711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:33.914387 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:33.914673 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:33.915067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:33.925068 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:33.926700 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:33.935216 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1425/2882] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:30:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 24 15:30:38.545763 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:38.560422 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eedf3-cb4e-4c6b-9558-bc1b36b032ae None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:38.566687 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:38.567358 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:38.567644 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:38.567924 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:38.570706 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:38.582954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:38.584997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:38.595959 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1458/2883] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:30:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:30:42.980093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:42.982743 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:42.988457 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=79 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:43.061414 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9343a3-6095-46dc-88ae-7705980e3908 service swift] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:43.063798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:43.064934 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:43.065488 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:43.065792 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] PATH_INFO: `/v3/users/cc711907b1ff466980be11077bbcec22` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:43.067614 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc711907b1ff466980be11077bbcec22)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:43.070602 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:43.308896 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc711907b1ff466980be11077bbcec22'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.325136 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc711907b1ff466980be11077bbcec22'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.411998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc711907b1ff466980be11077bbcec22'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.420043 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc711907b1ff466980be11077bbcec22'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.420855 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc711907b1ff466980be11077bbcec22'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.429160 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1426/2884] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:30:42 2022] DELETE /identity/v3/users/cc711907b1ff466980be11077bbcec22 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:43.720250 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:43.752446 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40609677-4367-46e5-b0ed-a427415d5c71 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:43.834756 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:43.835545 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:43.835830 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:43.836164 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] PATH_INFO: `/v3/projects/22cc2033fe35466ea543f22b88eec531` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:43.837337 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22cc2033fe35466ea543f22b88eec531)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:43.839305 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:43.966782 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:43.985342 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22cc2033fe35466ea543f22b88eec531', 'request_id': 'req-e3f48dd2-afc7-471d-b9ca-2303087f84f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.992048 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22cc2033fe35466ea543f22b88eec531', 'request_id': 'req-e3f48dd2-afc7-471d-b9ca-2303087f84f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:43.998234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22cc2033fe35466ea543f22b88eec531', 'request_id': 'req-e3f48dd2-afc7-471d-b9ca-2303087f84f0'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.119576 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] The token cache is being invalidate because project 22cc2033fe35466ea543f22b88eec531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:30:44.120466 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.120707 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.124311 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1459/2885] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:30:43 2022] DELETE /identity/v3/projects/22cc2033fe35466ea543f22b88eec531 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:44.129302 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:44.131998 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:44.169078 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7462e-b46a-46f2-81d4-3f9989665e33 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:44.243025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:44.243910 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:44.244194 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:44.244474 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] PATH_INFO: `/v3/users/b94413e947364811b4f66e4eed7867a3` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:44.245702 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94413e947364811b4f66e4eed7867a3)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:44.247793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:44.419438 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:44.426389 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94413e947364811b4f66e4eed7867a3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.441541 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94413e947364811b4f66e4eed7867a3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.520110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94413e947364811b4f66e4eed7867a3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.528790 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94413e947364811b4f66e4eed7867a3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.529670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-c3538628-380d-47fe-ba25-f98aa8f859c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94413e947364811b4f66e4eed7867a3'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:44.536275 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1427/2886] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:30:44 2022] DELETE /identity/v3/users/b94413e947364811b4f66e4eed7867a3 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:44.819547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:44.821870 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:44.835907 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48dd2-afc7-471d-b9ca-2303087f84f0 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:44.907555 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:44.908714 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:44.908993 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:44.909270 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] PATH_INFO: `/v3/projects/f44c7266695c4e63b42fd27f34c2141c` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:44.910523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44c7266695c4e63b42fd27f34c2141c)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:44.912982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:45.042351 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44c7266695c4e63b42fd27f34c2141c', 'request_id': 'req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:45.048833 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44c7266695c4e63b42fd27f34c2141c', 'request_id': 'req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:45.055240 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44c7266695c4e63b42fd27f34c2141c', 'request_id': 'req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:45.114138 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] The token cache is being invalidate because project f44c7266695c4e63b42fd27f34c2141c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:30:45.114511 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:45.115627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:30:45.117538 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1460/2887] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:30:44 2022] DELETE /identity/v3/projects/f44c7266695c4e63b42fd27f34c2141c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:30:52.326135 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfba5-f5dd-4f35-948c-fb72b1268ef8 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:52.327484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfba5-f5dd-4f35-948c-fb72b1268ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:52.327484 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cdfba5-f5dd-4f35-948c-fb72b1268ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:52.344951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-a4cdfba5-f5dd-4f35-948c-fb72b1268ef8 None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:30:52.346199 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a4cdfba5-f5dd-4f35-948c-fb72b1268ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:52.421360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1428/2888] 10.222.0.65 () {58 vars in 1009 bytes} [Fri Jun 24 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:30:52.433194 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:30:52.434601 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:30:52.479547 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:30:52.505539 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bf866-2db4-484f-a58d-f4e9f9ad8a34 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:30:52.512006 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:30:52.512667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:30:52.512994 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:30:52.513224 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:30:52.521960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:30:52.524315 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:30:52.532908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1461/2889] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:30:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:02.414360 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=48,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:02.743425 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=14 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:08.849767 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:08.850235 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:08.850372 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:08.868005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] MFA Rules not processed for user `4d6c4a1de21c4f1893e73c8d7f81a62e`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:08.870347 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:08.883296 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1429/2890] 10.222.0.65 () {58 vars in 967 bytes} [Fri Jun 24 15:31:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:08.895586 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:08.907120 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90fe80-6838-41c8-af7a-a842301ff524 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:08.912175 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd11123cb5a64281b8c0336ee2a56f0d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:08.912801 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:08.913078 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:08.913348 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:08.922070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:08.923717 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:08.931872 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1462/2891] 10.222.0.65 () {60 vars in 1384 bytes} [Fri Jun 24 15:31:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 24 15:31:11.999270 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:12.000735 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:12.065822 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32ac7-1008-4a08-a884-4a90e6eb8b5b None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:12.071081 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:12.071956 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:12.072236 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:12.072511 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] PATH_INFO: `/v3/users/edad6b83d91c4cca9d6c1d758b299776` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:12.073836 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=edad6b83d91c4cca9d6c1d758b299776)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:12.075651 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:12.248285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edad6b83d91c4cca9d6c1d758b299776'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.261827 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edad6b83d91c4cca9d6c1d758b299776'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.307772 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edad6b83d91c4cca9d6c1d758b299776'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.315447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edad6b83d91c4cca9d6c1d758b299776'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.319496 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-b3feb31c-04ae-4214-8268-e59d0574edcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edad6b83d91c4cca9d6c1d758b299776'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.323256 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1430/2892] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:31:11 2022] DELETE /identity/v3/users/edad6b83d91c4cca9d6c1d758b299776 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:31:12.578484 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:12.590045 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2af8d-18c1-4549-892c-3bf9577a5d33 service swift] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:12.648112 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:12.648960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:12.649234 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:12.649502 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] PATH_INFO: `/v3/projects/129eaf812c10489491fc43fd864885e3` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:12.650700 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=129eaf812c10489491fc43fd864885e3)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:12.652641 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:12.770847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129eaf812c10489491fc43fd864885e3', 'request_id': 'req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.777144 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129eaf812c10489491fc43fd864885e3', 'request_id': 'req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.783000 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129eaf812c10489491fc43fd864885e3', 'request_id': 'req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.826797 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] The token cache is being invalidate because project 129eaf812c10489491fc43fd864885e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:31:12.827009 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.827657 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-aaf81a7d-2b99-4c9a-8b9f-0bedcd2a1bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:31:12.829210 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1463/2893] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:31:12 2022] DELETE /identity/v3/projects/129eaf812c10489491fc43fd864885e3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:31:12.834237 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:12.834546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:12.834824 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:12.891402 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:12.892598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:12.923821 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:12.954067 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1431/2894] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:12.962984 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:12.963293 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:12.963575 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:12.983359 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:12.989893 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:12.992799 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1464/2895] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:12.997005 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.007537 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347a9cf-1b5d-4366-aced-b1d2a9c58902 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.012150 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.015311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.015311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.015311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] PATH_INFO: `/v3/domains` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.015311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80512) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 24 15:31:13.015311 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.015957 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.028086 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1432/2896] 10.222.0.65 () {58 vars in 1152 bytes} [Fri Jun 24 15:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 24 15:31:13.032452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.042621 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0289d6-11bc-4d6e-b005-3299aa46977f None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.047499 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.048141 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.048418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.048690 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.049375 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.051288 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.132847 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1465/2897] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:31:13 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:31:13.137688 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.148285 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70413ae-dc4c-45c3-bd7b-d74b0112398f admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.205198 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.206228 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.206514 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.206799 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.207502 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.209982 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.337748 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1433/2898] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:31:13 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:31:13.342117 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.353126 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a319803b-84ef-4ba8-aa19-9f703b98bb6f admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.357971 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.358640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.358944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.359219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.359949 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.361546 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.372973 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1466/2899] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:31:13.376948 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.387105 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef1b74-cda9-4c7e-868e-e1c1040bfd5e admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.391745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.392399 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.392785 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.392954 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.393681 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.395307 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10258cb6-21e5-42e2-8d7f-773a2a58fed0 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.406121 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1434/2900] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:31:13.410640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.421281 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb15000-736b-4b8f-a822-b7039f9b2a2a admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.425735 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.426617 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.426894 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.427166 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] PATH_INFO: `/v3/projects/d60f11c02be64f3e88661dc55da11b1a/users/08c268b0435e43b6bcd540b4d17cef01/roles/27f8457d6ec94bd2b715c76f7f05d279` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.442024 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60f11c02be64f3e88661dc55da11b1a, user_id=08c268b0435e43b6bcd540b4d17cef01, role_id=27f8457d6ec94bd2b715c76f7f05d279)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.444921 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.519336 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1467/2901] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:31:13 2022] PUT /identity/v3/projects/d60f11c02be64f3e88661dc55da11b1a/users/08c268b0435e43b6bcd540b4d17cef01/roles/27f8457d6ec94bd2b715c76f7f05d279 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 24 15:31:13.524647 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee4a7-830f-4274-9e5c-b46a50a87808 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.524953 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee4a7-830f-4274-9e5c-b46a50a87808 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.525232 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee4a7-830f-4274-9e5c-b46a50a87808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.543436 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-9f2ee4a7-830f-4274-9e5c-b46a50a87808 None None] MFA Rules not processed for user `f6d21cfc252e4afe8cc1bf635f18f2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:13.544637 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-9f2ee4a7-830f-4274-9e5c-b46a50a87808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:13.603862 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1435/2902] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:13.613683 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:13.615443 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:13.635908 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:13.702954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107991af-7aec-4b44-83cf-f9975ca1f9b2 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:13.706640 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:13.707280 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:13.707562 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:13.707838 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:13.717556 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:13.719190 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:13.730273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1468/2903] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:31:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:31:18.800187 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:18.801088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:18.801524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:18.832253 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.auth.core [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] MFA Rules not processed for user `08c268b0435e43b6bcd540b4d17cef01`. Rule list: `[]` (Enabled: `True`). {{(pid=80512) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:18.833939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:18.870749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:18.907810 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1436/2904] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:18.917436 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:18.924967 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cb979-ccc1-4afc-9b52-5b0f841352c2 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:18.932398 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:18.932691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:18.932933 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:18.933207 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:18.933934 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:18.936434 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.019029 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1469/2905] 10.222.0.65 () {60 vars in 1152 bytes} [Fri Jun 24 15:31:18 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:31:19.023615 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:19.035866 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e863af-ef7e-4165-a60f-baf1da1d8780 None None] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:19.112904 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:19.113584 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] REQUEST_METHOD: `POST` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:19.113897 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:19.114177 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] PATH_INFO: `/v3/users` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:19.114877 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:19.116867 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.205629 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1437/2906] 10.222.0.65 () {60 vars in 1143 bytes} [Fri Jun 24 15:31:19 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 24 15:31:19.210493 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:19.220944 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcefb6f-a3e9-488b-85b0-9b75590c1334 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:19.226292 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:19.226963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:19.227245 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:19.227523 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:19.228303 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:19.229931 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.241609 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1470/2907] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 24 15:31:19.245791 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:19.255992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799b2b0-384b-49ce-b5b6-7f380ec9643a admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:19.260600 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:19.261521 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:19.261830 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:19.262107 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] PATH_INFO: `/v3/projects/73bbcbd3958a4755be798974f3c480d4/users/0b47d1374c7d483684eb8916241e8dec/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:19.277668 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bbcbd3958a4755be798974f3c480d4, user_id=0b47d1374c7d483684eb8916241e8dec, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:19.280303 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.406337 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1438/2908] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:31:19 2022] PUT /identity/v3/projects/73bbcbd3958a4755be798974f3c480d4/users/0b47d1374c7d483684eb8916241e8dec/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:31:19.410439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:19.421017 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca13294-7705-42f6-b0fe-eeb93e6a72d3 admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:19.483299 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:19.483927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:19.484217 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:19.484513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] PATH_INFO: `/v3/roles` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:19.485238 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:19.486860 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84708f5f-4431-4ed9-a983-c485af67b36d admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.496969 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1471/2909] 10.222.0.65 () {58 vars in 1121 bytes} [Fri Jun 24 15:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 24 15:31:19.501189 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:19.511925 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217aeca7-7c97-4be5-8265-d1062ad0a723 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:19.516562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:19.517458 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:19.517761 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:19.518045 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] PATH_INFO: `/v3/projects/73bbcbd3958a4755be798974f3c480d4/users/0b47d1374c7d483684eb8916241e8dec/roles/13f9d35b508b4da8b84fcc1c1d7bd324` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:19.520024 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=73bbcbd3958a4755be798974f3c480d4, user_id=0b47d1374c7d483684eb8916241e8dec, role_id=13f9d35b508b4da8b84fcc1c1d7bd324)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:19.523338 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:19.534840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1439/2910] 10.222.0.65 () {60 vars in 1482 bytes} [Fri Jun 24 15:31:19 2022] PUT /identity/v3/projects/73bbcbd3958a4755be798974f3c480d4/users/0b47d1374c7d483684eb8916241e8dec/roles/13f9d35b508b4da8b84fcc1c1d7bd324 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:31:25.304667 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c115-8b2c-4fee-bbb3-7e835c43ea96 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:25.305198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c115-8b2c-4fee-bbb3-7e835c43ea96 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:25.305198 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7c115-8b2c-4fee-bbb3-7e835c43ea96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:25.334999 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-62b7c115-8b2c-4fee-bbb3-7e835c43ea96 None None] MFA Rules not processed for user `0b47d1374c7d483684eb8916241e8dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:25.336145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-62b7c115-8b2c-4fee-bbb3-7e835c43ea96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:25.384840 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:25.409975 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1472/2911] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:25.426375 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:25.428945 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:25.528789 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:25.533349 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1eeed-a645-487a-bfe8-1700a25925cc admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:25.539306 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:25.539989 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:25.540262 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:25.540530 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:25.600524 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:25.602294 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:25.611865 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1440/2912] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:31:28.349633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] REQUEST_METHOD: `POST` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:28.350197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:28.350197 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:28.368648 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.auth.core [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] MFA Rules not processed for user `08c268b0435e43b6bcd540b4d17cef01`. Rule list: `[]` (Enabled: `True`). {{(pid=80513) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 24 15:31:28.370411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:28.376927 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1473/2913] 10.222.0.65 () {58 vars in 957 bytes} [Fri Jun 24 15:31:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 24 15:31:35.942186 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=27 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:38.362960 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=10 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:44.098459 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:44.099900 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:44.222938 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e956b49-fdc2-4190-8c09-4240e705b110 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:44.230019 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:44.230679 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:44.230964 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:44.231246 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:44.236196 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:44.249082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:44.250690 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:44.260819 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1441/2914] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:31:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:31:45.273686 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:45.328070 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aceb26-a9bd-4255-a6aa-ea7fa519ec36 None None] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:45.331634 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:45.332273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:45.332553 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:45.332829 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:45.334613 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:45.344124 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:45.345542 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:45.353864 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1474/2915] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:31:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:31:54.256429 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=41 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:55.349918 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=26 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:31:59.027969 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:31:59.029419 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:31:59.041793 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ad3e-e49e-4c3c-9dbb-f480f8035c4a service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:31:59.045536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:31:59.047223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:31:59.047223 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:31:59.047494 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:31:59.059085 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:31:59.060546 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:31:59.071562 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1442/2916] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:31:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:32:09.066939 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=6 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:25.717146 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:34:25.726974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321126a7-02cb-4fa8-8dcb-d2d2e3f5381d service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:34:25.730606 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:34:25.731239 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:34:25.731520 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:34:25.731794 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:34:25.733691 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:34:25.748145 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:34:25.752447 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:34:25.760745 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1475/2917] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:34:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:34:26.941202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:34:26.950149 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bdaa28-4228-40af-b420-7232a7417555 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:34:26.953745 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:34:26.954516 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:34:26.954798 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:34:26.955072 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:34:26.956874 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:34:26.970711 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:34:26.972293 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:34:26.984886 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1443/2918] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:34:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:34:35.755698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=6 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:35.996200 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:34:36.004992 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c74b96-3ab1-4123-8235-e519bcd266d2 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:34:36.008604 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:34:36.009232 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:34:36.010211 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:34:36.010489 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:34:36.012258 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:34:36.021842 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:34:36.023252 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:34:36.031597 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1476/2919] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:34:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:34:36.979455 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=6 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:40.359693 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:34:40.368722 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513fe79-b802-4bb8-addc-39bbb1b7f572 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:34:40.372573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:34:40.373108 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:34:40.373385 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:34:40.373682 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:34:40.375490 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:34:40.386576 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:34:40.388088 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:34:40.396893 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1444/2920] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 24 15:34:40.470836 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:34:40.482954 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692585-70c4-426e-a2c1-1e74dd04e23c service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:34:40.486590 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:34:40.487231 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:34:40.487513 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:34:40.487788 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:34:40.489874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:34:40.504193 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:34:40.505614 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:34:40.518516 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1477/2921] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:34:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:34:50.393007 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=6 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:34:50.512378 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=12 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:35.577042 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:35.586361 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9591eb1-8949-4167-956c-f83a67317ab8 service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:35.589950 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:35.590573 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:35.590851 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:35.591122 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:35.599561 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:35.600973 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:35.610229 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1445/2922] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:36.775982 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:36.785845 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e56d0-642a-47da-85e3-59ba29688e07 service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:36.791974 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:36.792633 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:36.792917 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:36.793219 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:36.795080 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:36.809187 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:36.815594 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:36.823177 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1478/2923] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:39.370174 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:39.387110 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddd7e0-f157-4b9c-8f28-96a922721c2b service neutron] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:39.392840 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ecc895f2eaa245dc8f1b5d811a4c88e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:39.393478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:39.393783 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:39.394060 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:39.395850 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:39.409536 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:39.419820 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:39.422976 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1446/2924] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:41.301835 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:41.311727 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d74709-3ea8-41cf-85a2-5fbffa7be04e service nova] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:41.315995 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8131b0b0725f461a97be0423b7d8bb16', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:41.316627 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:41.316911 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:41.317188 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:41.378600 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:41.380400 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:41.391878 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1479/2925] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:44.935670 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:44.937401 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:44.952309 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b79505-5260-43f3-8f4b-013bf963ffe1 service nova] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:44.958111 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:44.963093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:44.963093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:44.963093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:44.963093 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:44.974001 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:44.975577 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:44.986391 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1447/2926] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:47.087810 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:47.104452 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42b015a-06cf-44b4-bf51-9e937deb234c service neutron] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:47.110439 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:47.111180 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] REQUEST_METHOD: `GET` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:47.111653 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:47.112199 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:47.122209 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:47.124437 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:47.142798 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1480/2927] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 24 15:36:48.620630 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:48.631943 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0f2ae-999d-43c5-bc21-c845dfd5fb96 service placement] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:48.636738 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:48.637623 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:48.637936 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:48.638206 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] PATH_INFO: `/v3/users/08c268b0435e43b6bcd540b4d17cef01` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:48.639465 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c268b0435e43b6bcd540b4d17cef01)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:48.641567 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:48.820905 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c268b0435e43b6bcd540b4d17cef01'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:48.832725 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c268b0435e43b6bcd540b4d17cef01'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:48.911057 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c268b0435e43b6bcd540b4d17cef01'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:48.918914 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c268b0435e43b6bcd540b4d17cef01'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:48.919598 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c268b0435e43b6bcd540b4d17cef01'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:48.926147 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1448/2928] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:36:48 2022] DELETE /identity/v3/users/08c268b0435e43b6bcd540b4d17cef01 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:36:49.176221 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:49.192504 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940d008-c219-46ad-bcdd-bec591bb8193 service placement] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:49.255875 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:49.256738 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:49.257021 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:49.257296 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] PATH_INFO: `/v3/projects/d60f11c02be64f3e88661dc55da11b1a` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:49.258505 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60f11c02be64f3e88661dc55da11b1a)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:49.260388 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:49.374417 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60f11c02be64f3e88661dc55da11b1a', 'request_id': 'req-076fe6aa-7761-4670-8e7b-de0491771e1b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.380660 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60f11c02be64f3e88661dc55da11b1a', 'request_id': 'req-076fe6aa-7761-4670-8e7b-de0491771e1b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.386698 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60f11c02be64f3e88661dc55da11b1a', 'request_id': 'req-076fe6aa-7761-4670-8e7b-de0491771e1b'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.488963 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:49.493889 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] The token cache is being invalidate because project d60f11c02be64f3e88661dc55da11b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:36:49.494185 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.494817 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.496370 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1481/2929] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:36:49 2022] DELETE /identity/v3/projects/d60f11c02be64f3e88661dc55da11b1a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:36:49.500588 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:49.502025 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:49.515231 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf7ab3f-7c46-4310-ba12-3e5f14306921 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:49.572478 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:49.573331 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:49.573616 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:49.573923 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] PATH_INFO: `/v3/users/0b47d1374c7d483684eb8916241e8dec` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:49.575109 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b47d1374c7d483684eb8916241e8dec)` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:49.577010 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:49.824519 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:36:49.834183 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b47d1374c7d483684eb8916241e8dec'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.846447 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b47d1374c7d483684eb8916241e8dec'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.980082 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b47d1374c7d483684eb8916241e8dec'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.987441 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b47d1374c7d483684eb8916241e8dec'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.988064 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.notifications [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b47d1374c7d483684eb8916241e8dec'} {{(pid=80512) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:49.995202 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1449/2930] 10.222.0.65 () {58 vars in 1223 bytes} [Fri Jun 24 15:36:49 2022] DELETE /identity/v3/users/0b47d1374c7d483684eb8916241e8dec => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:36:50.283742 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Authenticating user token {{(pid=80513) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:36:50.285212 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.fernet_utils [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80513) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:36:50.298107 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fe6aa-7761-4670-8e7b-de0491771e1b admin admin] Validating token access rules against request {{(pid=80513) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:36:50.356812 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f6d21cfc252e4afe8cc1bf635f18f2d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7700ba2abc17485289dad312ea30cdcc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80513) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:36:50.357678 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:36:50.357997 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:36:50.358273 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] PATH_INFO: `/v3/projects/73bbcbd3958a4755be798974f3c480d4` {{(pid=80513) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:36:50.359457 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73bbcbd3958a4755be798974f3c480d4)` {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:36:50.361418 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] RBAC: Authorization granted {{(pid=80513) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:36:50.500935 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73bbcbd3958a4755be798974f3c480d4', 'request_id': 'req-42e38fd4-752d-4b21-a1c0-18f7d8188778'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:50.507181 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73bbcbd3958a4755be798974f3c480d4', 'request_id': 'req-42e38fd4-752d-4b21-a1c0-18f7d8188778'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:50.512749 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73bbcbd3958a4755be798974f3c480d4', 'request_id': 'req-42e38fd4-752d-4b21-a1c0-18f7d8188778'} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:50.584874 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] The token cache is being invalidate because project 73bbcbd3958a4755be798974f3c480d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80513) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 24 15:36:50.585171 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:50.585843 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG keystone.notifications [None req-42e38fd4-752d-4b21-a1c0-18f7d8188778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80513) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 24 15:36:50.587440 dv-cinder-835384-11-smb devstack@keystone.service[80513]: [pid: 80513|app: 0|req: 1482/2931] 10.222.0.65 () {58 vars in 1232 bytes} [Fri Jun 24 15:36:50 2022] DELETE /identity/v3/projects/73bbcbd3958a4755be798974f3c480d4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 24 15:37:00.299749 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG dbcounter [-] [80512] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80512) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:37:00.581411 dv-cinder-835384-11-smb devstack@keystone.service[80513]: DEBUG dbcounter [-] [80513] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80513) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 15:41:50.133951 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Authenticating user token {{(pid=80512) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 24 15:41:50.135513 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:41:50.280102 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7586898-9585-474f-981a-9dc6d4621649 admin admin] Validating token access rules against request {{(pid=80512) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 24 15:41:50.344062 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d090a2340be4b6cbe533c22fbdf9057', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33717ea7e4ab4344bb085f272c78c674', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80512) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 24 15:41:50.344782 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] REQUEST_METHOD: `GET` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 24 15:41:50.344992 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] SCRIPT_NAME: `/identity` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 24 15:41:50.345267 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80512) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 24 15:41:50.347986 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.fernet_utils [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80512) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 24 15:41:50.361289 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 24 15:41:50.362991 dv-cinder-835384-11-smb devstack@keystone.service[80512]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbc1b2-a261-4459-a00b-7db32b6b1fef service placement] RBAC: Authorization granted {{(pid=80512) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 24 15:41:50.373907 dv-cinder-835384-11-smb devstack@keystone.service[80512]: [pid: 80512|app: 0|req: 1450/2932] 10.222.0.65 () {60 vars in 1365 bytes} [Fri Jun 24 15:41:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)